-- Logs begin at Tue 2022-10-04 08:10:35 UTC, end at Tue 2022-10-04 09:18:00 UTC. -- Oct 04 08:41:49.845553 dv-cinder-844563-14-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 08:41:49.855748 dv-cinder-844563-14-smb devstack@keystone.service[81438]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:41:49 2022] *** Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: nodename: dv-cinder-844563-14-smb Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: machine: x86_64 Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: clock source: unix Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: pcre jit disabled Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: detected number of CPU cores: 4 Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: current working directory: / Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: your processes number limit is 47680 Oct 04 08:41:49.858056 dv-cinder-844563-14-smb devstack@keystone.service[81438]: your memory page size is 4096 bytes Oct 04 08:41:49.858738 dv-cinder-844563-14-smb devstack@keystone.service[81438]: detected max file descriptor number: 2048 Oct 04 08:41:49.858738 dv-cinder-844563-14-smb devstack@keystone.service[81438]: lock engine: pthread robust mutexes Oct 04 08:41:49.858738 dv-cinder-844563-14-smb devstack@keystone.service[81438]: thunder lock: enabled Oct 04 08:41:49.858738 dv-cinder-844563-14-smb devstack@keystone.service[81438]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 08:41:49.858738 dv-cinder-844563-14-smb devstack@keystone.service[81438]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:41:49.897213 dv-cinder-844563-14-smb devstack@keystone.service[81438]: Python main interpreter initialized at 0x55d8f97f69c0 Oct 04 08:41:49.897213 dv-cinder-844563-14-smb devstack@keystone.service[81438]: python threads support enabled Oct 04 08:41:49.897213 dv-cinder-844563-14-smb devstack@keystone.service[81438]: your server socket listen backlog is limited to 100 connections Oct 04 08:41:49.897213 dv-cinder-844563-14-smb devstack@keystone.service[81438]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:41:49.897521 dv-cinder-844563-14-smb devstack@keystone.service[81438]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:41:49.897624 dv-cinder-844563-14-smb devstack@keystone.service[81438]: *** Operational MODE: preforking *** Oct 04 08:41:49.897885 dv-cinder-844563-14-smb devstack@keystone.service[81438]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:41:49.897885 dv-cinder-844563-14-smb devstack@keystone.service[81438]: spawned uWSGI master process (pid: 81438) Oct 04 08:41:49.898072 dv-cinder-844563-14-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 08:41:49.902112 dv-cinder-844563-14-smb devstack@keystone.service[81438]: spawned uWSGI worker 1 (pid: 81449, cores: 1) Oct 04 08:41:49.902112 dv-cinder-844563-14-smb devstack@keystone.service[81438]: spawned uWSGI worker 2 (pid: 81450, cores: 1) Oct 04 08:41:49.902112 dv-cinder-844563-14-smb devstack@keystone.service[81438]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:41:54.212612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:41:54.212612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Oct 04 08:41:54.213353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:41:54.213353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: from cryptography.utils import int_from_bytes Oct 04 08:41:54.213763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:41:54.213763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Oct 04 08:41:54.213862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:41:54.213862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: from cryptography.utils import int_from_bytes Oct 04 08:41:54.269153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:41:54.269324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:41:54.269414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:41:54.269503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:41:54.269594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] command line args: [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:41:54.269652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] command line args: [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:41:54.269833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:41:54.269933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:41:54.270015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ================================================================================ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:41:54.270104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ================================================================================ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:41:54.270292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.270381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] admin_token = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.270540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_dir = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.270630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_dir = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.270734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.270818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.270920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_source = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.270997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_source = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.271202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] debug = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.271299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] debug = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.271361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.271560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.271655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.271714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.271845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.271959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.272083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.272192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.272334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.272445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.272570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.272670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.272771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_config_append = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.272871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_config_append = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.272972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_dir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_dir = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273387 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.273996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274513 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.274987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.275147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.275227 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.275296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.275436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.275522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.275669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.275750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.275903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.275990 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.276152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.276274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.276388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.276500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.276660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.276790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.277148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.277265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.277390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] publish_errors = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.277499 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] publish_errors = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.277611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.277722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.277832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.277993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.278130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.279567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.279653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.279743 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.279821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.279891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.279959 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] standard_threads = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] standard_threads = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_journal = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_journal = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_json = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_json = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_stderr = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.280959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_stderr = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.281060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_syslog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.281164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_syslog = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.281242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.281310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:41:54.281377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.281444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.281517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.281664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.281742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.281810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.281887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.281961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282632 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.282994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.283069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.283137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.283204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.283271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.283429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.283518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.283678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.283815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.283929 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.284041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.284153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.284275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.284389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.284503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.284646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.284762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.284881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.285002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.285122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.285235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.285354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.285474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.285650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.285778 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.285898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.286011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.286163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.286280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.286392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.286576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.286691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.286804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.286916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.287029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.287029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.287249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.287368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.287481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.287594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.287706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.287830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.287943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.288061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.288175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.288287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.288405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.288526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.288641 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.288759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.288871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.288983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.289101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.289227 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.289340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.289452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.289570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.289690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.289803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.289922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.290035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.290177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.290290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.290402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.290551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.290662 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.290758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.290854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.290949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.291050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.291147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.291250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.291346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.291442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.291543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.291640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.291782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.291926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.292058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.292181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.292306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.292428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.292542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.292652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.292773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.292896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.293016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.293137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.293252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.293365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.293487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.294112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.294230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.294344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.294447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.294559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.294685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.294796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.294911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.295025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.295128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.295240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.295361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.295479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.295592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.295717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.295838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.295954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.296057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.296180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.296295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.296409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.296541 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.296648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.296752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.296863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.296962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.297076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.297180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.297295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.297416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.297532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.297646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.297766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.297880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.297994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.298236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.298356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.298470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.298583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.298696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.298810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.298934 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.299050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.299164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.299277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.299397 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.299517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.299640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.299771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.299898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.300013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.300127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.300241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.300355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.300468 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.300590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.300710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.300825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.300938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.301051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.301165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.301290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.301406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.301523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.301637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.301751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.301864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.301990 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.302134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.302252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.302395 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.302520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.302635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.302760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.302875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.302989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.303102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.303102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.303324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.303451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.303572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.303686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.303800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.303912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.304026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.304146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.304261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.304376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.304498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.304613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.304732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.304854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.304968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.305089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.305202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.305202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.305416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.305537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.305652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.305652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.305864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.306003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.external = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.306148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.306266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.306380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.external = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.306380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.306605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.306605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.306821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.306937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.password = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.307059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.307174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.token = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.307288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.password = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.307402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.307528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.token = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.307644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.307766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.307881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.307995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.308115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.308230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.308344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.308469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.308592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.308706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.308820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.308933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.309048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.309160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.309291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.309915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.310020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.310160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.310262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.316658 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.316767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.316856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.316924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.316995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317070 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.317927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318387 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.318958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.319954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.320952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.321930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.322950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.323993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.324997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325849 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.325986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.326991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327060 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.327942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.328092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.328213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.328358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.328481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.328607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.328716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.328858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.328940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.329108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.329187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.329349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.329427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.329585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.329664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.329824 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.329902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.330061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.330162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.330325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.330406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.330561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.330646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.330812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.330890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.331046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.331125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.331296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.331373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.331545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.331623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.331794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.331878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.332023 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.332100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.332271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.332349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.332505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.332590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.332742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.332820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.332982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.333059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.333221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.333298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.333464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.333542 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.333707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.333786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.333946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.334024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.334223 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.334301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.334456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.334532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.334705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.334787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.334943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.335074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.335192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.335305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.335430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.335546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.335661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.335775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.335890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.336005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.336126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.336241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.336356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.336470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.336584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.336698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.336820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.336937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.337051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.337166 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.337280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.337394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.337516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.337632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.337747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.337867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.337984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.338127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.338258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.338374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.338488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.338602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.338716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.338831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.338954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.339076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.339192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.339306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.339410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.339506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.339608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.339687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.339843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.339935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.340091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.340169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.340341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.340419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.340612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.340712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.340863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.340948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.341110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.341186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.341360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.341437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.341597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.341682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.341847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.341924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.342147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.342229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.342355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.342446 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.342600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.342678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.342852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.342998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.343128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.343237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.343475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.343580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.343718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.343821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.343968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.344080 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.344220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.344325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.344457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.344561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.344713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.344831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.344956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.345062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.345201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.345312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.345438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.345551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.345674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.345778 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.345908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.346013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.346451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.346557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.346675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.346791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.346906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.347020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.347143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.347259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.347259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.347475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.347590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.347704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.347826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.347942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.348056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.348170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.348285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.348400 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.348522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.348638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.348753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.348868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.348868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.349082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.349082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.349306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.349422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.349537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.349651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.349765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.349887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.350002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.350144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.350261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.350375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.350490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.350621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.350738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.350852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.350967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.351081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.351194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.351316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.351445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.351600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.351719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.351834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.351938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.351938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.352169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.352169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.352393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.352508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.352623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.352737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.352869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.352985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.353107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.353223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.353337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.353451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.353565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.353713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.353908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.354026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.354156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.354272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.354386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.354500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.354627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.354746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.354860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.354974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.355088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.355203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.355325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.355441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.355555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.355670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.355784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.355899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.356021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.356632 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.356748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.356863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.356977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.357092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:41:54.357215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.357215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:41:54.357215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:41:54.386766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.386973 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.390004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.390004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.390231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.390231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.395608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.395851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.424130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.424360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.424444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.424618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.480678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.480899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.530301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.530536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.531367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.531610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.691273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.691499 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.691723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.691814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.691947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.692053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.692172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.692254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.692393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.692474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.692617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.692838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.723986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.724222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.724315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.724456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.724560 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.724685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.724769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.724910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.724993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.725133 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.725217 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.725352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.725432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.725592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.737543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.737752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.750097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.750356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.750561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.750648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.756595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.756676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.756788 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.756903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.757002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.757091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.757167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.757240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.757240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.757240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:41:54.772395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.772613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:41:54.772696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.772834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:41:54.772956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.773161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:41:54.773258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.773370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:41:54.773452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.773649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.773737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.773922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.774011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.774183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.774268 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.774448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.784396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.784574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.784686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.784860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.784967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.785138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.785263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.785426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.792286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.792460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.795978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.796090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.796315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.796403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.796580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.796679 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.796868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.796961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.797155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.797235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.797418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.797496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.797690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.797770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.797966 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.798044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.798266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.798347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.798545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.798625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.798817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.798896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.821485 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.821713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.822990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.823262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.823346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.823557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.827984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.828284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.828366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.828572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.828653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.828861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.834961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.835251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.835335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.835633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.841407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.846600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.846695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.846811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.846891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847576 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.847725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.859707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.859991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.860210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.860496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.863898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.864435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.867153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.867458 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.867733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.868039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.871723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.872315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.874943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.875525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.878200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.878509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.878791 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.878887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.879079 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.879160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.879378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.879472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.879672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.879766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.879971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.880269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.896022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.896316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.896590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.896670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.896859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.896955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.897219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.897490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.904323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.905023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.905887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.906624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.907447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.907730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.908164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.908446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.910431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.910722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.911019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.911161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.911311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.911457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.911702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.911785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.912029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.912421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.922936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.923229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.923519 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.923769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.923844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.924066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.924185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.924356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.924489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.924650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.924776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.925039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.925327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.925613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.940284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.941139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.943267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.944097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.946184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.947118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.947769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.948590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.949399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.949690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.950602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.950735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.950938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.951342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.957098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.957783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.958584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.959291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.961491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.961896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.962212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.962298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.966172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.966343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.966343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.966343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.971053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.971350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.971648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.971730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.972014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.972313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.978573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.978868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.979155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.979286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:41:54.979436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.979581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.979723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.979869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.979999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.980154 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.980290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.980436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.980577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.980716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.980853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.981010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.981214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.981368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.981506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.981650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.981784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.981939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.982065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.982253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.982392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.982885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.983238 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:54.983519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:41:55.017930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8f97f69c0 pid: 81449 (default app) Oct 04 08:41:55.018348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d8f97f69c0 pid: 81450 (default app) Oct 04 08:41:55.021290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a447c5e-8d7a-4776-8c78-849159aba9e7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:41:55.021580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a447c5e-8d7a-4776-8c78-849159aba9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:41:55.021856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a447c5e-8d7a-4776-8c78-849159aba9e7 None None] PATH_INFO: `/v3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:41:55.025999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Tue Oct 4 08:41:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:02.738026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55045a14-777e-4390-a379-4d5f24a5033e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:02.738566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55045a14-777e-4390-a379-4d5f24a5033e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:02.738645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55045a14-777e-4390-a379-4d5f24a5033e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:02.742848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:02.748599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:02.749081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:02.749226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:02.820765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: INFO dbcounter [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] Registered counter for database keystone Oct 04 08:42:02.840203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG oslo_db.sqlalchemy.engines [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:42:02.846799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writer thread running {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:42:03.024421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81449) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 08:42:03.024738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81449) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 08:42:03.082560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:03.084140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:03.209507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 08:42:03.662941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55045a14-777e-4390-a379-4d5f24a5033e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:03.734230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: INFO dbcounter [None req-55045a14-777e-4390-a379-4d5f24a5033e None None] Registered counter for database keystone Oct 04 08:42:03.755734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG oslo_db.sqlalchemy.engines [None req-55045a14-777e-4390-a379-4d5f24a5033e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:42:03.762000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writer thread running {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:42:03.880462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55045a14-777e-4390-a379-4d5f24a5033e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:03.884737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecd0c9-7e9c-4058-9cab-375dc2d837f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:03.885367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecd0c9-7e9c-4058-9cab-375dc2d837f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:03.885651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecd0c9-7e9c-4058-9cab-375dc2d837f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:03.885926 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecd0c9-7e9c-4058-9cab-375dc2d837f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:03.894625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecd0c9-7e9c-4058-9cab-375dc2d837f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:03.946410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WARNING keystone.common.rbac_enforcer.enforcer [None req-73ecd0c9-7e9c-4058-9cab-375dc2d837f3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 08:42:03.946763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecd0c9-7e9c-4058-9cab-375dc2d837f3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:03.957039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Oct 4 08:42:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:42:03.963074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:03.980195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc730542-f722-4635-ba24-e78e7bd06462 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:03.984908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4b60-05c8-49e9-b19b-3b1cd59921ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:03.986000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4b60-05c8-49e9-b19b-3b1cd59921ac admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:03.986324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4b60-05c8-49e9-b19b-3b1cd59921ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:03.986593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4b60-05c8-49e9-b19b-3b1cd59921ac admin admin] PATH_INFO: `/v3/projects/ebfb49c53afc43dab99fad98da6b3e94` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:03.988170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd4b60-05c8-49e9-b19b-3b1cd59921ac admin admin] RBAC: Authorizing `identity:get_project(project_id=ebfb49c53afc43dab99fad98da6b3e94)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:04.040180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9bdd4b60-05c8-49e9-b19b-3b1cd59921ac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 08:42:04.040526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd4b60-05c8-49e9-b19b-3b1cd59921ac admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:04.044971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Tue Oct 4 08:42:03 2022] GET /identity/v3/projects/ebfb49c53afc43dab99fad98da6b3e94 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:06.131608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8a689-6667-41d2-bb88-8eb55b6187d7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:06.132113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8a689-6667-41d2-bb88-8eb55b6187d7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:06.132225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8a689-6667-41d2-bb88-8eb55b6187d7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:06.136275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:06.142305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467595ff-9a5a-43c9-89d3-c2c6cc98d24b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:06.142671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467595ff-9a5a-43c9-89d3-c2c6cc98d24b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:06.142868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467595ff-9a5a-43c9-89d3-c2c6cc98d24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:06.163299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-467595ff-9a5a-43c9-89d3-c2c6cc98d24b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:06.164813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-467595ff-9a5a-43c9-89d3-c2c6cc98d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:06.172657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 08:42:06.435813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8a689-6667-41d2-bb88-8eb55b6187d7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:06.447666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8a689-6667-41d2-bb88-8eb55b6187d7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:06.451845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213c87-acc1-471c-8053-c9c8559c4f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:06.452436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213c87-acc1-471c-8053-c9c8559c4f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:06.452716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213c87-acc1-471c-8053-c9c8559c4f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:06.452989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213c87-acc1-471c-8053-c9c8559c4f50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:06.460430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213c87-acc1-471c-8053-c9c8559c4f50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:06.462224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b213c87-acc1-471c-8053-c9c8559c4f50 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:06.470739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Oct 4 08:42:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:42:06.475964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467595ff-9a5a-43c9-89d3-c2c6cc98d24b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:06.485895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467595ff-9a5a-43c9-89d3-c2c6cc98d24b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:06.490267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cdeb1-4443-485e-9f11-6a96f0686dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:06.490895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cdeb1-4443-485e-9f11-6a96f0686dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:06.491182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cdeb1-4443-485e-9f11-6a96f0686dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:06.491462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cdeb1-4443-485e-9f11-6a96f0686dd5 admin admin] PATH_INFO: `/v3/users/f4c8e66e98594150bb55f964ec327f0b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:06.492791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cdeb1-4443-485e-9f11-6a96f0686dd5 admin admin] RBAC: Authorizing `identity:get_user(user_id=f4c8e66e98594150bb55f964ec327f0b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:06.494673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cdeb1-4443-485e-9f11-6a96f0686dd5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:06.496188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Tue Oct 4 08:42:06 2022] GET /identity/v3/users/f4c8e66e98594150bb55f964ec327f0b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:08.695325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ebff-0e49-4077-b1ae-6da26ad86294 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:08.695889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ebff-0e49-4077-b1ae-6da26ad86294 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:08.695889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ebff-0e49-4077-b1ae-6da26ad86294 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:08.697207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:08.702427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5461296-0375-4913-8b53-5102512be443 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:08.702862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5461296-0375-4913-8b53-5102512be443 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:08.702982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5461296-0375-4913-8b53-5102512be443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:08.720545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a5461296-0375-4913-8b53-5102512be443 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:08.721717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a5461296-0375-4913-8b53-5102512be443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:08.724081 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc036965-b829-47f3-bb94-fe98ffd15be2 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:08.724372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc036965-b829-47f3-bb94-fe98ffd15be2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:08.724647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc036965-b829-47f3-bb94-fe98ffd15be2 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:08.726214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:08.731586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa478-20ba-4a2c-9cde-1048338fbcd9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:08.731861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa478-20ba-4a2c-9cde-1048338fbcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:08.732129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aa478-20ba-4a2c-9cde-1048338fbcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:08.773605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG passlib.handlers.bcrypt [None req-bd5aa478-20ba-4a2c-9cde-1048338fbcd9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81450) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 08:42:08.773992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG passlib.handlers.bcrypt [None req-bd5aa478-20ba-4a2c-9cde-1048338fbcd9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81450) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 08:42:08.803491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:08.823255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bd5aa478-20ba-4a2c-9cde-1048338fbcd9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:08.824868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bd5aa478-20ba-4a2c-9cde-1048338fbcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:08.923144 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:09.072668 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5461296-0375-4913-8b53-5102512be443 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:09.097591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:09.174751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5461296-0375-4913-8b53-5102512be443 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:09.190398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa478-20ba-4a2c-9cde-1048338fbcd9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:09.208488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359b714-6456-4a3a-aa89-a292334de361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:09.209126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b714-6456-4a3a-aa89-a292334de361 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:09.209410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b714-6456-4a3a-aa89-a292334de361 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:09.209688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b714-6456-4a3a-aa89-a292334de361 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:09.221087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359b714-6456-4a3a-aa89-a292334de361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d359b714-6456-4a3a-aa89-a292334de361 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:09.229980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:09.230970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:09.231893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:09.237101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359b714-6456-4a3a-aa89-a292334de361 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:09.290144 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aa478-20ba-4a2c-9cde-1048338fbcd9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:09.292373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:09.317891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:09.325295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeebcf8-d87e-4148-adcf-cd6c8eada76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:09.326111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeebcf8-d87e-4148-adcf-cd6c8eada76a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:09.326414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeebcf8-d87e-4148-adcf-cd6c8eada76a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:09.326701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeebcf8-d87e-4148-adcf-cd6c8eada76a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:09.335726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359b714-6456-4a3a-aa89-a292334de361 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:09.369126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2b18b-2509-412e-9724-b9ba416a4898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:09.369748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2b18b-2509-412e-9724-b9ba416a4898 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:09.370029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2b18b-2509-412e-9724-b9ba416a4898 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:09.370327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2b18b-2509-412e-9724-b9ba416a4898 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:09.370995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2b18b-2509-412e-9724-b9ba416a4898 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:09.371302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2b18b-2509-412e-9724-b9ba416a4898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:09.372714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2b18b-2509-412e-9724-b9ba416a4898 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:09.384196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:09.390166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2b18b-2509-412e-9724-b9ba416a4898 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:09.393763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeebcf8-d87e-4148-adcf-cd6c8eada76a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:09.395324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeebcf8-d87e-4148-adcf-cd6c8eada76a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:09.487967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2b18b-2509-412e-9724-b9ba416a4898 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:09.492987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:42:09.498516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeebcf8-d87e-4148-adcf-cd6c8eada76a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:09.501109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:09.521677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4766491-8ca3-403e-b3aa-d171e5f701cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:09.522454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4766491-8ca3-403e-b3aa-d171e5f701cd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:09.522735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4766491-8ca3-403e-b3aa-d171e5f701cd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:09.523010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4766491-8ca3-403e-b3aa-d171e5f701cd None admin] PATH_INFO: `/v3/users/f4c8e66e98594150bb55f964ec327f0b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:09.524144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4766491-8ca3-403e-b3aa-d171e5f701cd None admin] RBAC: Authorizing `identity:get_user(user_id=f4c8e66e98594150bb55f964ec327f0b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:09.525600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4766491-8ca3-403e-b3aa-d171e5f701cd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:09.527181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:09 2022] GET /identity/v3/users/f4c8e66e98594150bb55f964ec327f0b => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:09.533016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4766491-8ca3-403e-b3aa-d171e5f701cd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:09.547505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:09.595541 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeebcf8-d87e-4148-adcf-cd6c8eada76a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:09.629007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f34d-353f-49cc-a65e-4966f30d93b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:09.629843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f34d-353f-49cc-a65e-4966f30d93b8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:09.630147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f34d-353f-49cc-a65e-4966f30d93b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:09.630420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85f34d-353f-49cc-a65e-4966f30d93b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:09.630515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4766491-8ca3-403e-b3aa-d171e5f701cd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:09.649482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85f34d-353f-49cc-a65e-4966f30d93b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:09.651371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85f34d-353f-49cc-a65e-4966f30d93b8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:09.663923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a0514-6aa3-4a4d-a617-ff3557a0dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:09.664546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a0514-6aa3-4a4d-a617-ff3557a0dd99 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:09.664825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a0514-6aa3-4a4d-a617-ff3557a0dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:09.665098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a0514-6aa3-4a4d-a617-ff3557a0dd99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:09.666233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a0514-6aa3-4a4d-a617-ff3557a0dd99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:09.667655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a0514-6aa3-4a4d-a617-ff3557a0dd99 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bc85f34d-353f-49cc-a65e-4966f30d93b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:42:09.669096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:09.670111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:42:09.671120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:42:09.671120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:42:09.671120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:09.671120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:42:09.674307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:09.675554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f34d-353f-49cc-a65e-4966f30d93b8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:09.677496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a0514-6aa3-4a4d-a617-ff3557a0dd99 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:09.731662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:09.756555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:09.775372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a0514-6aa3-4a4d-a617-ff3557a0dd99 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:09.777215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85f34d-353f-49cc-a65e-4966f30d93b8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:09.808811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382ca6c-276d-4dd0-ad37-113a4196101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:09.809651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d72f31-3c1a-4f3a-b50b-44382a3ef207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:09.809905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382ca6c-276d-4dd0-ad37-113a4196101d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:09.810228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382ca6c-276d-4dd0-ad37-113a4196101d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:09.810438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72f31-3c1a-4f3a-b50b-44382a3ef207 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:09.810546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382ca6c-276d-4dd0-ad37-113a4196101d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:09.810720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72f31-3c1a-4f3a-b50b-44382a3ef207 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:09.810992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d72f31-3c1a-4f3a-b50b-44382a3ef207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:09.811147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382ca6c-276d-4dd0-ad37-113a4196101d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:09.811455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382ca6c-276d-4dd0-ad37-113a4196101d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:09.811715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d72f31-3c1a-4f3a-b50b-44382a3ef207 None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.domain.id=default, user.id=f4c8e66e98594150bb55f964ec327f0b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:09.812023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d72f31-3c1a-4f3a-b50b-44382a3ef207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:09.812860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382ca6c-276d-4dd0-ad37-113a4196101d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:09.813449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d72f31-3c1a-4f3a-b50b-44382a3ef207 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:09.821346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 10/20] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Oct 4 08:42:09 2022] GET /identity/v3/role_assignments?user.id=f4c8e66e98594150bb55f964ec327f0b&scope.domain.id=default&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:09.831279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 11/21] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:12.154534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a7f1-c609-49ca-8edc-e13c6073886e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:12.155031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a7f1-c609-49ca-8edc-e13c6073886e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:12.155136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a7f1-c609-49ca-8edc-e13c6073886e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:12.156436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 11/22] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:12.162249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9220c-55da-46e1-9610-d5d35337769e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:12.162639 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9220c-55da-46e1-9610-d5d35337769e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:12.162800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9220c-55da-46e1-9610-d5d35337769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:12.187129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f1f9220c-55da-46e1-9610-d5d35337769e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:12.188404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f1f9220c-55da-46e1-9610-d5d35337769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:12.268633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:12.430377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694522-ade5-41f8-bbaa-b165594cef4e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:12.431012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694522-ade5-41f8-bbaa-b165594cef4e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:12.431504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694522-ade5-41f8-bbaa-b165594cef4e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:12.433040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:12.439077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294d58-d3aa-4bd2-a7b2-6347154b51f5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:12.439600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294d58-d3aa-4bd2-a7b2-6347154b51f5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:12.440077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294d58-d3aa-4bd2-a7b2-6347154b51f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:12.475284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-97294d58-d3aa-4bd2-a7b2-6347154b51f5 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:12.476866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-97294d58-d3aa-4bd2-a7b2-6347154b51f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:12.485535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790334-3e08-4da9-ba70-9011e7843919 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:12.486123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790334-3e08-4da9-ba70-9011e7843919 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:12.487023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790334-3e08-4da9-ba70-9011e7843919 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:12.489012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 13/25] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:12.493451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac14b55-ddf3-4655-bb7b-69953c1abf08 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:12.493996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac14b55-ddf3-4655-bb7b-69953c1abf08 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:12.494512 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac14b55-ddf3-4655-bb7b-69953c1abf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:12.531157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4ac14b55-ddf3-4655-bb7b-69953c1abf08 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:12.532394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4ac14b55-ddf3-4655-bb7b-69953c1abf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:12.587481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:12.596530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 13/26] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:12.660431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 14/27] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:12.683560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97294d58-d3aa-4bd2-a7b2-6347154b51f5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:12.807471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97294d58-d3aa-4bd2-a7b2-6347154b51f5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:12.850949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f5e95-7dfd-4bd5-a9ea-6a3c1d411c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:12.851597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f5e95-7dfd-4bd5-a9ea-6a3c1d411c8c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:12.851887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f5e95-7dfd-4bd5-a9ea-6a3c1d411c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:12.852163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f5e95-7dfd-4bd5-a9ea-6a3c1d411c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:12.863203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f5e95-7dfd-4bd5-a9ea-6a3c1d411c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-288f5e95-7dfd-4bd5-a9ea-6a3c1d411c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:12.868191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:12.869002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:12.869740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 14/28] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:42:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:12.875849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac14b55-ddf3-4655-bb7b-69953c1abf08 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:12.946189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:13.010015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac14b55-ddf3-4655-bb7b-69953c1abf08 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:13.051027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f5e95-7dfd-4bd5-a9ea-6a3c1d411c8c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:13.062750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae48410-b72b-443d-b871-ba59b10247f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:13.063353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae48410-b72b-443d-b871-ba59b10247f5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:13.063640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae48410-b72b-443d-b871-ba59b10247f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:13.063919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae48410-b72b-443d-b871-ba59b10247f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:13.064597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae48410-b72b-443d-b871-ba59b10247f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:13.064902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae48410-b72b-443d-b871-ba59b10247f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:13.070105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae48410-b72b-443d-b871-ba59b10247f5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:13.085737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 15/29] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:13.092390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae48410-b72b-443d-b871-ba59b10247f5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:13.184707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:13.266019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f5e95-7dfd-4bd5-a9ea-6a3c1d411c8c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:13.294772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae48410-b72b-443d-b871-ba59b10247f5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:13.317126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:13.328893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f435122-676d-45ae-8380-a5c841f3b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:13.329525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f435122-676d-45ae-8380-a5c841f3b77d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:13.329804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f435122-676d-45ae-8380-a5c841f3b77d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:13.331571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f435122-676d-45ae-8380-a5c841f3b77d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:13.344344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f435122-676d-45ae-8380-a5c841f3b77d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:13.346033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f435122-676d-45ae-8380-a5c841f3b77d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:13.347122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaaa04-dfff-4fc2-bc3e-9fbf84771d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:13.347988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaaa04-dfff-4fc2-bc3e-9fbf84771d8d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:13.348406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaaa04-dfff-4fc2-bc3e-9fbf84771d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:13.348832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaaa04-dfff-4fc2-bc3e-9fbf84771d8d None admin] PATH_INFO: `/v3/users/f4c8e66e98594150bb55f964ec327f0b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:13.350477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaaa04-dfff-4fc2-bc3e-9fbf84771d8d None admin] RBAC: Authorizing `identity:get_user(user_id=f4c8e66e98594150bb55f964ec327f0b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:13.352076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abaaa04-dfff-4fc2-bc3e-9fbf84771d8d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:13.358307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 16/30] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:13 2022] GET /identity/v3/users/f4c8e66e98594150bb55f964ec327f0b => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:13.359294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaaa04-dfff-4fc2-bc3e-9fbf84771d8d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7f435122-676d-45ae-8380-a5c841f3b77d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:42:13.369398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:13.370431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:42:13.371771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:42:13.371771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:42:13.371771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:13.371771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 15/31] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:42:13.371986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f435122-676d-45ae-8380-a5c841f3b77d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:13.478972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaaa04-dfff-4fc2-bc3e-9fbf84771d8d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:13.489622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f435122-676d-45ae-8380-a5c841f3b77d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:13.506726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:13.524627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490bda0-ed2d-40a5-914d-6b5081adaa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:13.526037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490bda0-ed2d-40a5-914d-6b5081adaa5f None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:13.526617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490bda0-ed2d-40a5-914d-6b5081adaa5f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:13.527071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490bda0-ed2d-40a5-914d-6b5081adaa5f None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:13.528412 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490bda0-ed2d-40a5-914d-6b5081adaa5f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:13.529962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490bda0-ed2d-40a5-914d-6b5081adaa5f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:13.533511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7985217-99af-474f-82fb-d10981f36af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:13.534553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7985217-99af-474f-82fb-d10981f36af2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:13.534944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7985217-99af-474f-82fb-d10981f36af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:13.535306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7985217-99af-474f-82fb-d10981f36af2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:13.536508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7985217-99af-474f-82fb-d10981f36af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:13.538715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7985217-99af-474f-82fb-d10981f36af2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:13.540533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 16/32] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:13.541841 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc6f5f-1572-49fd-990c-36c8303494c4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:13.542292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc6f5f-1572-49fd-990c-36c8303494c4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:13.542706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc6f5f-1572-49fd-990c-36c8303494c4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:13.544597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:13.545873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc6f5f-1572-49fd-990c-36c8303494c4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:13.663227 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc6f5f-1572-49fd-990c-36c8303494c4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:13.703158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f61d-f425-410e-873b-992309b4b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:13.704082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f61d-f425-410e-873b-992309b4b20a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:13.704514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f61d-f425-410e-873b-992309b4b20a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:13.704942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292f61d-f425-410e-873b-992309b4b20a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:13.705748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292f61d-f425-410e-873b-992309b4b20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:13.706270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292f61d-f425-410e-873b-992309b4b20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:13.707905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292f61d-f425-410e-873b-992309b4b20a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:13.721745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 18/34] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:13.722949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f61d-f425-410e-873b-992309b4b20a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:13.756533 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 17/35] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 08:42:13 2022] POST /identity/v3/roles => generated 219 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:13.762986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0cf05-5d3f-420f-a657-6e5b79623a13 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:13.763276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0cf05-5d3f-420f-a657-6e5b79623a13 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:13.763556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0cf05-5d3f-420f-a657-6e5b79623a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:13.774547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:13.807237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-65b0cf05-5d3f-420f-a657-6e5b79623a13 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:13.808920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-65b0cf05-5d3f-420f-a657-6e5b79623a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:13.848387 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292f61d-f425-410e-873b-992309b4b20a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:13.892275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d7d7-44ed-40b4-b346-1315334f1fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:13.892870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:13.893429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d7d7-44ed-40b4-b346-1315334f1fef None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:13.893848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d7d7-44ed-40b4-b346-1315334f1fef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:13.894304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d7d7-44ed-40b4-b346-1315334f1fef None admin] PATH_INFO: `/v3/domains/default/users/f4c8e66e98594150bb55f964ec327f0b/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:13.897615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d7d7-44ed-40b4-b346-1315334f1fef None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f4c8e66e98594150bb55f964ec327f0b, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:13.899492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d7d7-44ed-40b4-b346-1315334f1fef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:13.950252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 18/36] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:13.951924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0cf05-5d3f-420f-a657-6e5b79623a13 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:14.147929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0cf05-5d3f-420f-a657-6e5b79623a13 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:14.196326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef8ee3-eddf-419c-944e-03133a3760c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:14.196896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef8ee3-eddf-419c-944e-03133a3760c8 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.197182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef8ee3-eddf-419c-944e-03133a3760c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.197533 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef8ee3-eddf-419c-944e-03133a3760c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.198263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef8ee3-eddf-419c-944e-03133a3760c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:14.200022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef8ee3-eddf-419c-944e-03133a3760c8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:14.290347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 19/37] 10.222.0.33 () {58 vars in 1361 bytes} [Tue Oct 4 08:42:13 2022] PUT /identity/v3/domains/default/users/f4c8e66e98594150bb55f964ec327f0b/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:14.292095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd19394-1148-42b2-ba22-05fbf4e38843 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.292394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd19394-1148-42b2-ba22-05fbf4e38843 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.292678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd19394-1148-42b2-ba22-05fbf4e38843 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.297312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 20/38] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:14.298608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bf181-ef04-4df2-bfde-eb056836132e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.298904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bf181-ef04-4df2-bfde-eb056836132e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.299220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bf181-ef04-4df2-bfde-eb056836132e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.300756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 21/39] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:14.301373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bf181-ef04-4df2-bfde-eb056836132e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:14.339711 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 19/40] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:42:13 2022] POST /identity/v3/projects => generated 301 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:14.341903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3469c-08c8-4518-9274-13e1f0634f80 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.342299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3469c-08c8-4518-9274-13e1f0634f80 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.342652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3469c-08c8-4518-9274-13e1f0634f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.365621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e2c3469c-08c8-4518-9274-13e1f0634f80 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:14.367389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e2c3469c-08c8-4518-9274-13e1f0634f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:14.392507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:14.436950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:14.443008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bf181-ef04-4df2-bfde-eb056836132e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:14.466016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 20/41] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:14.467857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e545d9a-d13f-470d-a3be-82474020dadf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.468294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e545d9a-d13f-470d-a3be-82474020dadf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.468807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e545d9a-d13f-470d-a3be-82474020dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.500581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8e545d9a-d13f-470d-a3be-82474020dadf None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:14.503281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8e545d9a-d13f-470d-a3be-82474020dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:14.504517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c7976-08c9-416f-8492-7fb815ac7073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:14.505354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c7976-08c9-416f-8492-7fb815ac7073 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.505781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c7976-08c9-416f-8492-7fb815ac7073 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.506233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c7976-08c9-416f-8492-7fb815ac7073 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.507069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c7976-08c9-416f-8492-7fb815ac7073 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:14.508787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c7976-08c9-416f-8492-7fb815ac7073 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:14.581405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 21/42] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:14.593655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 22/43] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 08:42:14 2022] POST /identity/v3/roles => generated 225 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:14.757917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e545d9a-d13f-470d-a3be-82474020dadf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:14.853140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:14.871725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e545d9a-d13f-470d-a3be-82474020dadf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:14.888077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c7976-08c9-416f-8492-7fb815ac7073 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:14.908101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82dea-04b6-4c90-94cc-d731d5a87faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:14.908739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82dea-04b6-4c90-94cc-d731d5a87faa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:14.909019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82dea-04b6-4c90-94cc-d731d5a87faa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:14.909290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82dea-04b6-4c90-94cc-d731d5a87faa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:14.910432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa82dea-04b6-4c90-94cc-d731d5a87faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:14.911888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa82dea-04b6-4c90-94cc-d731d5a87faa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:14.913460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 22/44] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:14.918811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82dea-04b6-4c90-94cc-d731d5a87faa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:14.994047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c7976-08c9-416f-8492-7fb815ac7073 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:15.030073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101f3b5-a75d-44fb-862d-b241c60c9937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:15.030748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101f3b5-a75d-44fb-862d-b241c60c9937 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:15.031036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101f3b5-a75d-44fb-862d-b241c60c9937 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:15.031421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101f3b5-a75d-44fb-862d-b241c60c9937 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:15.032087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101f3b5-a75d-44fb-862d-b241c60c9937 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:15.033484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101f3b5-a75d-44fb-862d-b241c60c9937 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:15.034519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82dea-04b6-4c90-94cc-d731d5a87faa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:15.068363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00723eef-b133-4012-a8d2-5e25fbde38ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:15.068978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723eef-b133-4012-a8d2-5e25fbde38ba None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:15.069269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723eef-b133-4012-a8d2-5e25fbde38ba None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:15.069553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00723eef-b133-4012-a8d2-5e25fbde38ba None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:15.070242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00723eef-b133-4012-a8d2-5e25fbde38ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:15.071693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00723eef-b133-4012-a8d2-5e25fbde38ba None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:15.107476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 08:42:14 2022] POST /identity/v3/roles => generated 223 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:42:15.185504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:42:14 2022] POST /identity/v3/projects => generated 312 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:42:16.506434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfb0e5-539c-4592-9282-0a01f97855c7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:16.506954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfb0e5-539c-4592-9282-0a01f97855c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:16.507052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfb0e5-539c-4592-9282-0a01f97855c7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:16.508326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 24/47] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:16.513959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe837c-e12d-4696-9f6b-4a9583281161 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:16.514387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe837c-e12d-4696-9f6b-4a9583281161 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:16.514545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe837c-e12d-4696-9f6b-4a9583281161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:16.520739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:16.532549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c8fe837c-e12d-4696-9f6b-4a9583281161 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:16.533733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c8fe837c-e12d-4696-9f6b-4a9583281161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:16.597551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 24/48] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:16.864038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfb0e5-539c-4592-9282-0a01f97855c7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:16.886462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:16.965588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfb0e5-539c-4592-9282-0a01f97855c7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:16.999733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c867c8d-a25c-485f-9daf-913240ccaf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:17.000361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c867c8d-a25c-485f-9daf-913240ccaf0d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.000645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c867c8d-a25c-485f-9daf-913240ccaf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.000922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c867c8d-a25c-485f-9daf-913240ccaf0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.010905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c867c8d-a25c-485f-9daf-913240ccaf0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0c867c8d-a25c-485f-9daf-913240ccaf0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:17.015767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:17.016739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:17.017496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 25/49] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:17.024229 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe837c-e12d-4696-9f6b-4a9583281161 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:17.123667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe837c-e12d-4696-9f6b-4a9583281161 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:17.151753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:17.156496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620f4c4-de2a-4fae-9eda-603788846674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:17.157110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620f4c4-de2a-4fae-9eda-603788846674 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.157396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620f4c4-de2a-4fae-9eda-603788846674 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.157672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620f4c4-de2a-4fae-9eda-603788846674 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.158377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620f4c4-de2a-4fae-9eda-603788846674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:17.158686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620f4c4-de2a-4fae-9eda-603788846674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:17.160069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620f4c4-de2a-4fae-9eda-603788846674 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:17.168287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 25/50] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:17.173904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c867c8d-a25c-485f-9daf-913240ccaf0d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:17.257238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:17.275969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c867c8d-a25c-485f-9daf-913240ccaf0d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:17.308252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ad90a-6cd4-47b7-b1c3-83c16944eafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:17.309409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad90a-6cd4-47b7-b1c3-83c16944eafc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.309687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad90a-6cd4-47b7-b1c3-83c16944eafc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.309955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad90a-6cd4-47b7-b1c3-83c16944eafc None admin] PATH_INFO: `/v3/users/f4c8e66e98594150bb55f964ec327f0b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.311114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ad90a-6cd4-47b7-b1c3-83c16944eafc None admin] RBAC: Authorizing `identity:get_user(user_id=f4c8e66e98594150bb55f964ec327f0b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:17.312565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ad90a-6cd4-47b7-b1c3-83c16944eafc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:17.314472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 26/51] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:17 2022] GET /identity/v3/users/f4c8e66e98594150bb55f964ec327f0b => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:17.319982 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620f4c4-de2a-4fae-9eda-603788846674 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:17.338329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0d48-f78c-4b41-9380-ae430af556f8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.338620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0d48-f78c-4b41-9380-ae430af556f8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.338897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0d48-f78c-4b41-9380-ae430af556f8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.340245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 27/52] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:17.345223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90cdc-f719-4d2d-8c30-5056e57eb016 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.345517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90cdc-f719-4d2d-8c30-5056e57eb016 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.345794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b90cdc-f719-4d2d-8c30-5056e57eb016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.363654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f7b90cdc-f719-4d2d-8c30-5056e57eb016 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:17.365149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f7b90cdc-f719-4d2d-8c30-5056e57eb016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:17.422592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620f4c4-de2a-4fae-9eda-603788846674 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:17.431376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 28/53] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:17.454832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16c7e3-0f90-4fcb-9f92-0ccc10018678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:17.455462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c7e3-0f90-4fcb-9f92-0ccc10018678 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.455742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c7e3-0f90-4fcb-9f92-0ccc10018678 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.456016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16c7e3-0f90-4fcb-9f92-0ccc10018678 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.457126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16c7e3-0f90-4fcb-9f92-0ccc10018678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:17.458613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16c7e3-0f90-4fcb-9f92-0ccc10018678 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:17.460168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 26/54] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:17.465971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90cdc-f719-4d2d-8c30-5056e57eb016 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:17.540364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:17.561608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b90cdc-f719-4d2d-8c30-5056e57eb016 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:17.594199 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d596869-d46d-4c62-84a0-03d96b199baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:17.594815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d596869-d46d-4c62-84a0-03d96b199baa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.595103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d596869-d46d-4c62-84a0-03d96b199baa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.595386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d596869-d46d-4c62-84a0-03d96b199baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.596121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d596869-d46d-4c62-84a0-03d96b199baa None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.domain.id=default, user.id=f4c8e66e98594150bb55f964ec327f0b) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:17.596437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d596869-d46d-4c62-84a0-03d96b199baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:17.597902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d596869-d46d-4c62-84a0-03d96b199baa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:17.604859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 29/55] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Oct 4 08:42:17 2022] GET /identity/v3/role_assignments?user.id=f4c8e66e98594150bb55f964ec327f0b&scope.domain.id=default&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:17.701900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16c7e3-0f90-4fcb-9f92-0ccc10018678 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:17.765555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:17.806314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16c7e3-0f90-4fcb-9f92-0ccc10018678 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:17.839168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131d75-825c-4a10-8cd0-2ae88cdd8b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:17.839814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131d75-825c-4a10-8cd0-2ae88cdd8b33 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.840604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131d75-825c-4a10-8cd0-2ae88cdd8b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.840880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131d75-825c-4a10-8cd0-2ae88cdd8b33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.841996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131d75-825c-4a10-8cd0-2ae88cdd8b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:17.843498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131d75-825c-4a10-8cd0-2ae88cdd8b33 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:17.845073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 27/56] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:17.850851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d596869-d46d-4c62-84a0-03d96b199baa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:17.949009 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d596869-d46d-4c62-84a0-03d96b199baa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:17.982669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db99b24-2300-421b-b8bd-e3d46ffe4bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:17.983218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99b24-2300-421b-b8bd-e3d46ffe4bb5 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:17.983506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99b24-2300-421b-b8bd-e3d46ffe4bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:17.983787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99b24-2300-421b-b8bd-e3d46ffe4bb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:17.984440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db99b24-2300-421b-b8bd-e3d46ffe4bb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:17.985914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db99b24-2300-421b-b8bd-e3d46ffe4bb5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:18.000631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:18.066341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 30/57] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Oct 4 08:42:17 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:20.174583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94b6c-8700-492c-9d93-86e4f498f70e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:20.175111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94b6c-8700-492c-9d93-86e4f498f70e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:20.175111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94b6c-8700-492c-9d93-86e4f498f70e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:20.176468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 28/58] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:20.181499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c31fa-5acf-41de-a120-f045359d2272 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:20.181913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c31fa-5acf-41de-a120-f045359d2272 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:20.182068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c31fa-5acf-41de-a120-f045359d2272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:20.199936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-300c31fa-5acf-41de-a120-f045359d2272 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:20.201111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-300c31fa-5acf-41de-a120-f045359d2272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:20.264587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 31/59] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:20.528029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e94b6c-8700-492c-9d93-86e4f498f70e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:20.727504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e94b6c-8700-492c-9d93-86e4f498f70e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:20.756056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:20.761344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3145c7d-98d8-4323-adbd-68891d961031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:20.761986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145c7d-98d8-4323-adbd-68891d961031 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:20.762294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145c7d-98d8-4323-adbd-68891d961031 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:20.762573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145c7d-98d8-4323-adbd-68891d961031 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:20.764489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3145c7d-98d8-4323-adbd-68891d961031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:20.765917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3145c7d-98d8-4323-adbd-68891d961031 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:20.767520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 29/60] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:20.773056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c31fa-5acf-41de-a120-f045359d2272 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:20.867002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c31fa-5acf-41de-a120-f045359d2272 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:20.889907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:20.900290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa910a9e-129b-459f-b555-583340b1a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:20.900893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa910a9e-129b-459f-b555-583340b1a252 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:20.901177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa910a9e-129b-459f-b555-583340b1a252 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:20.901455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa910a9e-129b-459f-b555-583340b1a252 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:20.902134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa910a9e-129b-459f-b555-583340b1a252 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:20.903604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa910a9e-129b-459f-b555-583340b1a252 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:21.015220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 32/61] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:42:20 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:24.364613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20322-100d-4c90-b01e-14e96e966977 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.364613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20322-100d-4c90-b01e-14e96e966977 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.364613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20322-100d-4c90-b01e-14e96e966977 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.364613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 30/62] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:24.371857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cebaf-b054-4054-8825-a4cf26c80c77 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.372360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cebaf-b054-4054-8825-a4cf26c80c77 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.372429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cebaf-b054-4054-8825-a4cf26c80c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.399321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a97cebaf-b054-4054-8825-a4cf26c80c77 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:24.400585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a97cebaf-b054-4054-8825-a4cf26c80c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:24.432862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22910d-d3a5-4c1f-8b89-38e4385fb9d6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.433398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22910d-d3a5-4c1f-8b89-38e4385fb9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.433818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22910d-d3a5-4c1f-8b89-38e4385fb9d6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.435669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:24.440432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817e594-800f-460a-8b8f-a1c58de01a6f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.440977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817e594-800f-460a-8b8f-a1c58de01a6f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.441454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817e594-800f-460a-8b8f-a1c58de01a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.459969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a817e594-800f-460a-8b8f-a1c58de01a6f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:24.461490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a817e594-800f-460a-8b8f-a1c58de01a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:24.495608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 33/64] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:24.522206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb1a8-5d84-4fac-abef-fbcb1a19e86e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.522490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb1a8-5d84-4fac-abef-fbcb1a19e86e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.522966 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb1a8-5d84-4fac-abef-fbcb1a19e86e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.525923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 34/65] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:24.530530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57abb-1a77-4683-8c70-2d5df105e0f9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.531092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57abb-1a77-4683-8c70-2d5df105e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.531563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c57abb-1a77-4683-8c70-2d5df105e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.540602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 32/66] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:24.551395 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-34c57abb-1a77-4683-8c70-2d5df105e0f9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:24.552875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-34c57abb-1a77-4683-8c70-2d5df105e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:24.657880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 35/67] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:24.780673 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817e594-800f-460a-8b8f-a1c58de01a6f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:24.896253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817e594-800f-460a-8b8f-a1c58de01a6f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:24.913260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5334-fca3-4c68-bf26-137cc9ea1ec5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.913833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5334-fca3-4c68-bf26-137cc9ea1ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.914328 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e5334-fca3-4c68-bf26-137cc9ea1ec5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.918179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 36/68] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:24.921419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd37f5-06c7-4b8b-bb60-59344c529cd7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.921777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd37f5-06c7-4b8b-bb60-59344c529cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.922235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd37f5-06c7-4b8b-bb60-59344c529cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.924730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:24.950126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03593e7-3d59-48af-98db-f74fb26fe583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:24.951080 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03593e7-3d59-48af-98db-f74fb26fe583 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.951522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03593e7-3d59-48af-98db-f74fb26fe583 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.951955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03593e7-3d59-48af-98db-f74fb26fe583 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.963075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fddd37f5-06c7-4b8b-bb60-59344c529cd7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:24.965504 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fddd37f5-06c7-4b8b-bb60-59344c529cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:24.973009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03593e7-3d59-48af-98db-f74fb26fe583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c03593e7-3d59-48af-98db-f74fb26fe583 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:24.980084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:24.991574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 33/69] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:42:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:24.992324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72807c74-a620-4f49-a16f-5981c6eb4bed None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:24.993022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72807c74-a620-4f49-a16f-5981c6eb4bed None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:24.993022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72807c74-a620-4f49-a16f-5981c6eb4bed None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:24.993022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 34/70] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:24.994953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72807c74-a620-4f49-a16f-5981c6eb4bed None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.010786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:25.042920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 37/71] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:25.045870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80280604-636c-4000-9b74-f46a83b4d675 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.046256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80280604-636c-4000-9b74-f46a83b4d675 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.046552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80280604-636c-4000-9b74-f46a83b4d675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.065414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-80280604-636c-4000-9b74-f46a83b4d675 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:25.066647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-80280604-636c-4000-9b74-f46a83b4d675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:25.101032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72807c74-a620-4f49-a16f-5981c6eb4bed None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.136172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf342f-36f9-49f8-a6e8-d3d8bb495056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.137016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf342f-36f9-49f8-a6e8-d3d8bb495056 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.137966 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf342f-36f9-49f8-a6e8-d3d8bb495056 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.138450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf342f-36f9-49f8-a6e8-d3d8bb495056 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.138551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 38/72] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:25.139320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80280604-636c-4000-9b74-f46a83b4d675 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.139435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf342f-36f9-49f8-a6e8-d3d8bb495056 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:25.140040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf342f-36f9-49f8-a6e8-d3d8bb495056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:25.141554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf342f-36f9-49f8-a6e8-d3d8bb495056 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:25.159893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 35/73] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:42:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:25.161468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf342f-36f9-49f8-a6e8-d3d8bb495056 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.269711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:25.272771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80280604-636c-4000-9b74-f46a83b4d675 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.317602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:25.336126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb5b79-65da-4be8-8ba1-8b1ac0a0b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.337281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb5b79-65da-4be8-8ba1-8b1ac0a0b854 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.337709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb5b79-65da-4be8-8ba1-8b1ac0a0b854 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.338298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb5b79-65da-4be8-8ba1-8b1ac0a0b854 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.351870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb5b79-65da-4be8-8ba1-8b1ac0a0b854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-89eb5b79-65da-4be8-8ba1-8b1ac0a0b854 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:25.359060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:25.360029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:25.360967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:25.363528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 39/74] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:25.364609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb5b79-65da-4be8-8ba1-8b1ac0a0b854 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.374457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf342f-36f9-49f8-a6e8-d3d8bb495056 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.412695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3e247-80b7-46dc-9181-f362c3f9f9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.413339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3e247-80b7-46dc-9181-f362c3f9f9bb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.413620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3e247-80b7-46dc-9181-f362c3f9f9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.413899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3e247-80b7-46dc-9181-f362c3f9f9bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.428557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3e247-80b7-46dc-9181-f362c3f9f9bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fbc3e247-80b7-46dc-9181-f362c3f9f9bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:25.433475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:25.434375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:25.435139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 36/75] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:25.435929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3e247-80b7-46dc-9181-f362c3f9f9bb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.477926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb5b79-65da-4be8-8ba1-8b1ac0a0b854 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.513246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d698578-1c37-4a68-a556-77dcb023699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.513887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698578-1c37-4a68-a556-77dcb023699f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.514223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698578-1c37-4a68-a556-77dcb023699f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.514514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698578-1c37-4a68-a556-77dcb023699f None admin] PATH_INFO: `/v3/users/92f50ac3a70a40c081782c0cf02c739f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.530474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d698578-1c37-4a68-a556-77dcb023699f None admin] RBAC: Authorizing `identity:get_user(user_id=92f50ac3a70a40c081782c0cf02c739f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:25.531886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d698578-1c37-4a68-a556-77dcb023699f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:25.533543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 40/76] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/users/92f50ac3a70a40c081782c0cf02c739f => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:25.538871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d698578-1c37-4a68-a556-77dcb023699f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.553444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3e247-80b7-46dc-9181-f362c3f9f9bb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.556834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:25.565201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:25.587721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3ce4a-0497-4baf-9122-4bfdab30577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.588359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3ce4a-0497-4baf-9122-4bfdab30577c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.588645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3ce4a-0497-4baf-9122-4bfdab30577c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.588928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3ce4a-0497-4baf-9122-4bfdab30577c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.599320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3ce4a-0497-4baf-9122-4bfdab30577c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-22e3ce4a-0497-4baf-9122-4bfdab30577c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:25.604113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:25.605118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:25.605900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 37/77] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:25.607586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3ce4a-0497-4baf-9122-4bfdab30577c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.644567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d698578-1c37-4a68-a556-77dcb023699f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.677091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56902af-b540-45a4-a0ea-a22f27e18a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.677697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56902af-b540-45a4-a0ea-a22f27e18a49 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.677984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56902af-b540-45a4-a0ea-a22f27e18a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.678291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56902af-b540-45a4-a0ea-a22f27e18a49 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.678963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56902af-b540-45a4-a0ea-a22f27e18a49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:25.679271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56902af-b540-45a4-a0ea-a22f27e18a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:25.680660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56902af-b540-45a4-a0ea-a22f27e18a49 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:25.688673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 41/78] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:25.689295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56902af-b540-45a4-a0ea-a22f27e18a49 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.710068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3ce4a-0497-4baf-9122-4bfdab30577c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.743148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5682691-0929-47fc-ba64-2333163a4444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.743782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5682691-0929-47fc-ba64-2333163a4444 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.744068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5682691-0929-47fc-ba64-2333163a4444 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.744344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5682691-0929-47fc-ba64-2333163a4444 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.745478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5682691-0929-47fc-ba64-2333163a4444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:25.747613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5682691-0929-47fc-ba64-2333163a4444 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:25.753646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 38/79] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:25.753646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5682691-0929-47fc-ba64-2333163a4444 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.776062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:25.793103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:25.795034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56902af-b540-45a4-a0ea-a22f27e18a49 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.828278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e174215-9850-4c15-be49-af5104b0f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.828892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e174215-9850-4c15-be49-af5104b0f37b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.829180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e174215-9850-4c15-be49-af5104b0f37b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.829461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e174215-9850-4c15-be49-af5104b0f37b None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.830168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e174215-9850-4c15-be49-af5104b0f37b None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:25.830479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e174215-9850-4c15-be49-af5104b0f37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:25.831880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e174215-9850-4c15-be49-af5104b0f37b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:25.839789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 42/80] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:25.840712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e174215-9850-4c15-be49-af5104b0f37b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.852986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5682691-0929-47fc-ba64-2333163a4444 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.889543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb2b93-23a2-4724-81fb-b22d6f71d146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.890239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb2b93-23a2-4724-81fb-b22d6f71d146 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.890525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb2b93-23a2-4724-81fb-b22d6f71d146 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.890824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb2b93-23a2-4724-81fb-b22d6f71d146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.938384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e174215-9850-4c15-be49-af5104b0f37b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:25.959249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb2b93-23a2-4724-81fb-b22d6f71d146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:25.960759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb2b93-23a2-4724-81fb-b22d6f71d146 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:25.971176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77d6c-8483-44eb-ba9b-066685e82dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:25.971784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77d6c-8483-44eb-ba9b-066685e82dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:25.972072 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77d6c-8483-44eb-ba9b-066685e82dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:25.972351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce77d6c-8483-44eb-ba9b-066685e82dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:25.973021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce77d6c-8483-44eb-ba9b-066685e82dc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:25.973327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce77d6c-8483-44eb-ba9b-066685e82dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:25.974733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce77d6c-8483-44eb-ba9b-066685e82dc1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:25.982902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 43/81] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:25.983693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77d6c-8483-44eb-ba9b-066685e82dc1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:25.987660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:26.005408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:26.062712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 39/82] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:26.063456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb2b93-23a2-4724-81fb-b22d6f71d146 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:26.087252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce77d6c-8483-44eb-ba9b-066685e82dc1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:26.126401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5ca07-4dd9-4be6-89a1-eb0c336eee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:26.127024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ca07-4dd9-4be6-89a1-eb0c336eee6a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:26.127306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ca07-4dd9-4be6-89a1-eb0c336eee6a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:26.127581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5ca07-4dd9-4be6-89a1-eb0c336eee6a None admin] PATH_INFO: `/v3/users/f4c8e66e98594150bb55f964ec327f0b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:26.128707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5ca07-4dd9-4be6-89a1-eb0c336eee6a None admin] RBAC: Authorizing `identity:get_user(user_id=f4c8e66e98594150bb55f964ec327f0b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:26.130202 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5ca07-4dd9-4be6-89a1-eb0c336eee6a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:26.131763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 44/83] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:25 2022] GET /identity/v3/users/f4c8e66e98594150bb55f964ec327f0b => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:26.134919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5ca07-4dd9-4be6-89a1-eb0c336eee6a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:26.162552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb2b93-23a2-4724-81fb-b22d6f71d146 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:26.194905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431d6a5-b1d6-440a-99cb-9759d48db306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:26.195543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431d6a5-b1d6-440a-99cb-9759d48db306 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:26.195833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431d6a5-b1d6-440a-99cb-9759d48db306 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:26.196118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431d6a5-b1d6-440a-99cb-9759d48db306 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:26.196783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431d6a5-b1d6-440a-99cb-9759d48db306 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:26.198304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431d6a5-b1d6-440a-99cb-9759d48db306 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:26.201494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:26.212788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:26.229852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5ca07-4dd9-4be6-89a1-eb0c336eee6a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:26.263225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7122f-2c2c-4491-a20a-e1d98bd5542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:26.263836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7122f-2c2c-4491-a20a-e1d98bd5542a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:26.264117 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7122f-2c2c-4491-a20a-e1d98bd5542a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:26.264394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7122f-2c2c-4491-a20a-e1d98bd5542a None admin] PATH_INFO: `/v3/users/92f50ac3a70a40c081782c0cf02c739f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:26.265515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7122f-2c2c-4491-a20a-e1d98bd5542a None admin] RBAC: Authorizing `identity:get_user(user_id=92f50ac3a70a40c081782c0cf02c739f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:26.267014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7122f-2c2c-4491-a20a-e1d98bd5542a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:26.268570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 45/84] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:26 2022] GET /identity/v3/users/92f50ac3a70a40c081782c0cf02c739f => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:26.269405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7122f-2c2c-4491-a20a-e1d98bd5542a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:26.286061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 40/85] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:42:26 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:26.286917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431d6a5-b1d6-440a-99cb-9759d48db306 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:26.391351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7122f-2c2c-4491-a20a-e1d98bd5542a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:26.409735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431d6a5-b1d6-440a-99cb-9759d48db306 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:26.431160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a77f-2869-44dc-91e6-870fef14c51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:26.431827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a77f-2869-44dc-91e6-870fef14c51f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:26.432111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a77f-2869-44dc-91e6-870fef14c51f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:26.432387 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a77f-2869-44dc-91e6-870fef14c51f None admin] PATH_INFO: `/v3/users/92f50ac3a70a40c081782c0cf02c739f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:26.433707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78a77f-2869-44dc-91e6-870fef14c51f None admin] RBAC: Authorizing `identity:get_user(user_id=92f50ac3a70a40c081782c0cf02c739f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:26.435890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78a77f-2869-44dc-91e6-870fef14c51f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:26.437586 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 46/86] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:26 2022] GET /identity/v3/users/92f50ac3a70a40c081782c0cf02c739f => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:26.442301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a77f-2869-44dc-91e6-870fef14c51f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:26.450487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:26.453387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3607f-6d6f-410a-b632-2721212069ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:26.454051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3607f-6d6f-410a-b632-2721212069ff None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:26.454368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3607f-6d6f-410a-b632-2721212069ff None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:26.454651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3607f-6d6f-410a-b632-2721212069ff None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:26.455826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3607f-6d6f-410a-b632-2721212069ff None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:26.457315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3607f-6d6f-410a-b632-2721212069ff None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:26.462241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 41/87] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:26 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:26.469865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3607f-6d6f-410a-b632-2721212069ff None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:26.535882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:26.556073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a77f-2869-44dc-91e6-870fef14c51f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:26.588039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3607f-6d6f-410a-b632-2721212069ff None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:26.605314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e41d-16df-4fc8-8460-513254d6314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:26.606454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e41d-16df-4fc8-8460-513254d6314e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:26.606738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e41d-16df-4fc8-8460-513254d6314e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:26.607472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e41d-16df-4fc8-8460-513254d6314e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:26.632368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f700c-fc4a-4495-9e4e-caa9d6b7fe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:26.632873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f700c-fc4a-4495-9e4e-caa9d6b7fe01 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:26.633158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f700c-fc4a-4495-9e4e-caa9d6b7fe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:26.633494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f700c-fc4a-4495-9e4e-caa9d6b7fe01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:26.688755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e41d-16df-4fc8-8460-513254d6314e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:26.690416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e41d-16df-4fc8-8460-513254d6314e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:26.708055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:26.724583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f700c-fc4a-4495-9e4e-caa9d6b7fe01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:26.727215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f700c-fc4a-4495-9e4e-caa9d6b7fe01 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:26.802626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:26.810840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 47/88] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:26.811908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e41d-16df-4fc8-8460-513254d6314e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:26.847820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 42/89] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:26.848890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f700c-fc4a-4495-9e4e-caa9d6b7fe01 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:26.953938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e41d-16df-4fc8-8460-513254d6314e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:26.963645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:26.978211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f700c-fc4a-4495-9e4e-caa9d6b7fe01 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:26.990228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c5e81-b15b-4893-b315-632edd555029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:26.991155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5e81-b15b-4893-b315-632edd555029 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:26.991925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5e81-b15b-4893-b315-632edd555029 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:26.992415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c5e81-b15b-4893-b315-632edd555029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:27.024117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa2bc4-be7b-43d6-807e-3ce196f83a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:27.025618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa2bc4-be7b-43d6-807e-3ce196f83a8a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:27.026049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa2bc4-be7b-43d6-807e-3ce196f83a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:27.026751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa2bc4-be7b-43d6-807e-3ce196f83a8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:27.027630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa2bc4-be7b-43d6-807e-3ce196f83a8a None admin] RBAC: Adding query filter params (role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16, user.id=92f50ac3a70a40c081782c0cf02c739f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:27.028373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa2bc4-be7b-43d6-807e-3ce196f83a8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:27.030699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa2bc4-be7b-43d6-807e-3ce196f83a8a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:27.037448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 43/90] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:26 2022] GET /identity/v3/role_assignments?user.id=92f50ac3a70a40c081782c0cf02c739f&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:27.038436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa2bc4-be7b-43d6-807e-3ce196f83a8a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:27.072907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:27.115008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c5e81-b15b-4893-b315-632edd555029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:27.117227 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c5e81-b15b-4893-b315-632edd555029 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:27.162671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa2bc4-be7b-43d6-807e-3ce196f83a8a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:27.203453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c91ca-20c6-4000-8a5b-f97ebdb32cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:27.204416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c91ca-20c6-4000-8a5b-f97ebdb32cdd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:27.204963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c91ca-20c6-4000-8a5b-f97ebdb32cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:27.205395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c91ca-20c6-4000-8a5b-f97ebdb32cdd None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:27.206798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c91ca-20c6-4000-8a5b-f97ebdb32cdd None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:27.209452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c91ca-20c6-4000-8a5b-f97ebdb32cdd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:27.211646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 44/91] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:27 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:27.212661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c91ca-20c6-4000-8a5b-f97ebdb32cdd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:27.308994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 48/92] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:27.310694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c5e81-b15b-4893-b315-632edd555029 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:27.324283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:27.340933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:27.348188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c91ca-20c6-4000-8a5b-f97ebdb32cdd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:27.386928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86fbc-3db1-4d0b-b3c2-4842bc9af06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:27.387959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86fbc-3db1-4d0b-b3c2-4842bc9af06b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:27.388382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86fbc-3db1-4d0b-b3c2-4842bc9af06b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:27.388795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86fbc-3db1-4d0b-b3c2-4842bc9af06b None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:27.390249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f86fbc-3db1-4d0b-b3c2-4842bc9af06b None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:27.392326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f86fbc-3db1-4d0b-b3c2-4842bc9af06b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:27.394184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 45/93] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:27 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:27.395319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86fbc-3db1-4d0b-b3c2-4842bc9af06b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:27.451317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c5e81-b15b-4893-b315-632edd555029 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:27.510615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86fbc-3db1-4d0b-b3c2-4842bc9af06b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:27.526787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0ace3-01bd-4bd8-9a3a-a4b1bec72fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:27.527416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0ace3-01bd-4bd8-9a3a-a4b1bec72fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:27.527715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0ace3-01bd-4bd8-9a3a-a4b1bec72fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:27.528541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0ace3-01bd-4bd8-9a3a-a4b1bec72fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:27.529254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0ace3-01bd-4bd8-9a3a-a4b1bec72fe6 None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16, user.id=f4c8e66e98594150bb55f964ec327f0b) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:27.529567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0ace3-01bd-4bd8-9a3a-a4b1bec72fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:27.531061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0ace3-01bd-4bd8-9a3a-a4b1bec72fe6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:27.548236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 49/94] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:27 2022] GET /identity/v3/role_assignments?user.id=f4c8e66e98594150bb55f964ec327f0b&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:27.548861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0ace3-01bd-4bd8-9a3a-a4b1bec72fe6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:27.550219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabcb6d-e2fe-441c-b633-f4a0b8e856bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:27.551091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabcb6d-e2fe-441c-b633-f4a0b8e856bb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:27.551704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabcb6d-e2fe-441c-b633-f4a0b8e856bb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:27.552181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabcb6d-e2fe-441c-b633-f4a0b8e856bb None admin] PATH_INFO: `/v3/projects/1282621234724b56b2d1fe16bc095bf6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:27.553972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabcb6d-e2fe-441c-b633-f4a0b8e856bb None admin] RBAC: Authorizing `identity:get_project(project_id=1282621234724b56b2d1fe16bc095bf6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:27.555789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabcb6d-e2fe-441c-b633-f4a0b8e856bb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:27.557813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 46/95] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:27 2022] GET /identity/v3/projects/1282621234724b56b2d1fe16bc095bf6 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:27.563840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabcb6d-e2fe-441c-b633-f4a0b8e856bb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:27.632775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:27.698312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:27.759880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0ace3-01bd-4bd8-9a3a-a4b1bec72fe6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:27.760840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabcb6d-e2fe-441c-b633-f4a0b8e856bb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:27.799754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da979d59-dfee-4f2a-a74f-d4f72d51e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:27.800751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da979d59-dfee-4f2a-a74f-d4f72d51e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:27.801231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da979d59-dfee-4f2a-a74f-d4f72d51e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:27.801707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da979d59-dfee-4f2a-a74f-d4f72d51e1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:27.802765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da979d59-dfee-4f2a-a74f-d4f72d51e1c2 None admin] RBAC: Adding query filter params (role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=1282621234724b56b2d1fe16bc095bf6, user.id=92f50ac3a70a40c081782c0cf02c739f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:27.803294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da979d59-dfee-4f2a-a74f-d4f72d51e1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:27.805053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da979d59-dfee-4f2a-a74f-d4f72d51e1c2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:27.808080 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82299be4-4471-4b10-95e3-62def88ac2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:27.808719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82299be4-4471-4b10-95e3-62def88ac2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:27.809005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82299be4-4471-4b10-95e3-62def88ac2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:27.809807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82299be4-4471-4b10-95e3-62def88ac2b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:27.810900 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82299be4-4471-4b10-95e3-62def88ac2b2 None admin] RBAC: Adding query filter params (role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16, user.id=92f50ac3a70a40c081782c0cf02c739f) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:27.811006 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82299be4-4471-4b10-95e3-62def88ac2b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:27.812478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82299be4-4471-4b10-95e3-62def88ac2b2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:27.814136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 47/96] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:27 2022] GET /identity/v3/role_assignments?user.id=92f50ac3a70a40c081782c0cf02c739f&scope.project.id=1282621234724b56b2d1fe16bc095bf6&role.id=522cad34ce354f77b50e5490fdb6174d => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:27.818643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 50/97] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:27 2022] GET /identity/v3/role_assignments?user.id=92f50ac3a70a40c081782c0cf02c739f&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=522cad34ce354f77b50e5490fdb6174d => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:28.844344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28f0e-3adf-45e2-ab09-c01089293a5f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:28.845369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28f0e-3adf-45e2-ab09-c01089293a5f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:28.845956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d28f0e-3adf-45e2-ab09-c01089293a5f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:28.847627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 48/98] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:28.863141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f716-23cd-4c50-a6c4-b107d15c7218 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:28.864045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f716-23cd-4c50-a6c4-b107d15c7218 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:28.864539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738f716-23cd-4c50-a6c4-b107d15c7218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:28.886320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0738f716-23cd-4c50-a6c4-b107d15c7218 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:28.887939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0738f716-23cd-4c50-a6c4-b107d15c7218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:28.975549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 51/99] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:29.248130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d28f0e-3adf-45e2-ab09-c01089293a5f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:29.352838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:29.361483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d28f0e-3adf-45e2-ab09-c01089293a5f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:29.399770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f72823-bb6d-48c0-8f57-5f3bca77d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:29.400413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f72823-bb6d-48c0-8f57-5f3bca77d84b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:29.400704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f72823-bb6d-48c0-8f57-5f3bca77d84b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:29.401181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f72823-bb6d-48c0-8f57-5f3bca77d84b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:29.413174 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f72823-bb6d-48c0-8f57-5f3bca77d84b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a6f72823-bb6d-48c0-8f57-5f3bca77d84b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:29.418503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:29.419322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:29.420069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 49/100] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:42:29.425691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f716-23cd-4c50-a6c4-b107d15c7218 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:29.494930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:29.504162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad0ad5-4f94-4033-8be6-7df50d820c6f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:29.504409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad0ad5-4f94-4033-8be6-7df50d820c6f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:29.504660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad0ad5-4f94-4033-8be6-7df50d820c6f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:29.507601 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 50/101] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:29.513496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1f28-16d8-41d7-a1b8-32c5ac7fef19 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:29.515500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1f28-16d8-41d7-a1b8-32c5ac7fef19 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:29.515500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1f28-16d8-41d7-a1b8-32c5ac7fef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:29.535224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7c1d1f28-16d8-41d7-a1b8-32c5ac7fef19 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:29.536502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7c1d1f28-16d8-41d7-a1b8-32c5ac7fef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:29.557832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738f716-23cd-4c50-a6c4-b107d15c7218 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:29.614936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 51/102] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:29.618898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daf2a4-6dd1-4bd3-a5ad-56152585f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:29.619729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf2a4-6dd1-4bd3-a5ad-56152585f530 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:29.620193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf2a4-6dd1-4bd3-a5ad-56152585f530 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:29.620671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf2a4-6dd1-4bd3-a5ad-56152585f530 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:29.621569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daf2a4-6dd1-4bd3-a5ad-56152585f530 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:29.622215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daf2a4-6dd1-4bd3-a5ad-56152585f530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:29.623781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daf2a4-6dd1-4bd3-a5ad-56152585f530 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:29.640031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 52/103] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:29.645791 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1f28-16d8-41d7-a1b8-32c5ac7fef19 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:29.761315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:29.776965 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1f28-16d8-41d7-a1b8-32c5ac7fef19 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:29.870888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a452e-b61f-443d-8f82-87461a65e4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:29.871680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a452e-b61f-443d-8f82-87461a65e4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:29.871899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a452e-b61f-443d-8f82-87461a65e4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:29.872237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a452e-b61f-443d-8f82-87461a65e4c9 None admin] PATH_INFO: `/v3/users/c2974f3438324963a16196f40a37d8f5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:29.887614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a452e-b61f-443d-8f82-87461a65e4c9 None admin] RBAC: Authorizing `identity:get_user(user_id=c2974f3438324963a16196f40a37d8f5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:29.889073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a452e-b61f-443d-8f82-87461a65e4c9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:29.890745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 52/104] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:29 2022] GET /identity/v3/users/c2974f3438324963a16196f40a37d8f5 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:29.896445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daf2a4-6dd1-4bd3-a5ad-56152585f530 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:30.019784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daf2a4-6dd1-4bd3-a5ad-56152585f530 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:30.048933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:30.057399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1f124-687a-4ea5-95b9-1a629a4cda32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:30.058097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f124-687a-4ea5-95b9-1a629a4cda32 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:30.058394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f124-687a-4ea5-95b9-1a629a4cda32 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:30.058675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1f124-687a-4ea5-95b9-1a629a4cda32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:30.123591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a452e-b61f-443d-8f82-87461a65e4c9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:30.148496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1f124-687a-4ea5-95b9-1a629a4cda32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:30.149993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1f124-687a-4ea5-95b9-1a629a4cda32 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:30.302433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a452e-b61f-443d-8f82-87461a65e4c9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:30.326646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 53/105] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:30.327995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011545-1084-4175-9f57-4bac6ddd48c5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:30.328447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011545-1084-4175-9f57-4bac6ddd48c5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:30.333243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011545-1084-4175-9f57-4bac6ddd48c5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:30.334812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 54/106] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:30.337035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8011545-1084-4175-9f57-4bac6ddd48c5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:30.374157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:30.394975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c2a45-e0e9-4fc8-a027-32520c3acbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:30.395651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2a45-e0e9-4fc8-a027-32520c3acbef None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:30.395995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2a45-e0e9-4fc8-a027-32520c3acbef None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:30.396289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2a45-e0e9-4fc8-a027-32520c3acbef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:30.397600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c2a45-e0e9-4fc8-a027-32520c3acbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:30.399178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c2a45-e0e9-4fc8-a027-32520c3acbef None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:30.400915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 53/107] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:30.402243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6dca3-01ed-4578-aa7c-5aea54eba223 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:30.402504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6dca3-01ed-4578-aa7c-5aea54eba223 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:30.403344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6dca3-01ed-4578-aa7c-5aea54eba223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:30.439100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b4d6dca3-01ed-4578-aa7c-5aea54eba223 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:30.440314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b4d6dca3-01ed-4578-aa7c-5aea54eba223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:30.451738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:30.493048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8011545-1084-4175-9f57-4bac6ddd48c5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:30.535214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 54/108] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:30.536061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6dca3-01ed-4578-aa7c-5aea54eba223 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:30.560598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a30629-a4ea-44a7-b52c-4e10d1694a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:30.561541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a30629-a4ea-44a7-b52c-4e10d1694a4c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:30.562056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a30629-a4ea-44a7-b52c-4e10d1694a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:30.562578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a30629-a4ea-44a7-b52c-4e10d1694a4c None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:30.566235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a30629-a4ea-44a7-b52c-4e10d1694a4c None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:30.567967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a30629-a4ea-44a7-b52c-4e10d1694a4c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:30.570057 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 55/109] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:30 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:30.571412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff54c53-2506-475b-8dde-661d98afe489 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:30.571914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff54c53-2506-475b-8dde-661d98afe489 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:30.572382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff54c53-2506-475b-8dde-661d98afe489 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:30.582105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 56/110] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:30.582105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff54c53-2506-475b-8dde-661d98afe489 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:30.685646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6dca3-01ed-4578-aa7c-5aea54eba223 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:30.755128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a517e9-2063-41f6-871e-1b1f5f17192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:30.755749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a517e9-2063-41f6-871e-1b1f5f17192c None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:30.756033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a517e9-2063-41f6-871e-1b1f5f17192c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:30.756312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a517e9-2063-41f6-871e-1b1f5f17192c None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:30.756968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a517e9-2063-41f6-871e-1b1f5f17192c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:30.758461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a517e9-2063-41f6-871e-1b1f5f17192c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:30.766935 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:30.779639 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff54c53-2506-475b-8dde-661d98afe489 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:30.802129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:30.826524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4970df4-987c-46ff-8119-4e220d26c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:30.827076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970df4-987c-46ff-8119-4e220d26c105 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:30.827411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970df4-987c-46ff-8119-4e220d26c105 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:30.827697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970df4-987c-46ff-8119-4e220d26c105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:30.828442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4970df4-987c-46ff-8119-4e220d26c105 None admin] RBAC: Adding query filter params (role.id=d9df243cfd5148769d90f26f275d55d6, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16, user.id=c2974f3438324963a16196f40a37d8f5) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:30.828759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4970df4-987c-46ff-8119-4e220d26c105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:30.830337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4970df4-987c-46ff-8119-4e220d26c105 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:30.836200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 57/111] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:30 2022] GET /identity/v3/role_assignments?user.id=c2974f3438324963a16196f40a37d8f5&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=d9df243cfd5148769d90f26f275d55d6 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:30.837411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480bdf-7853-426a-ad99-3f9bd28c4827 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:30.837751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480bdf-7853-426a-ad99-3f9bd28c4827 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:30.838033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14480bdf-7853-426a-ad99-3f9bd28c4827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:30.857672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-14480bdf-7853-426a-ad99-3f9bd28c4827 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:30.858915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14480bdf-7853-426a-ad99-3f9bd28c4827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:30.880247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 55/112] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:42:30 2022] POST /identity/v3/projects => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:30.881186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a517e9-2063-41f6-871e-1b1f5f17192c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:31.038225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 58/113] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:31.104880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a517e9-2063-41f6-871e-1b1f5f17192c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:31.151360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c64dfa-5f3d-4715-98bc-5b16af4edbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:31.152007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c64dfa-5f3d-4715-98bc-5b16af4edbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:31.152337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c64dfa-5f3d-4715-98bc-5b16af4edbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:31.152615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c64dfa-5f3d-4715-98bc-5b16af4edbb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:31.168212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c64dfa-5f3d-4715-98bc-5b16af4edbb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f1c64dfa-5f3d-4715-98bc-5b16af4edbb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:31.174324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:31.175177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:31.176010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 56/114] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:42:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:31.181551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480bdf-7853-426a-ad99-3f9bd28c4827 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:31.245164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaf460-9e81-4f28-b41f-644cbd8dd688 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:31.245800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaf460-9e81-4f28-b41f-644cbd8dd688 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:31.246313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaf460-9e81-4f28-b41f-644cbd8dd688 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:31.248888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 57/115] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:31.254775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e739c5-8b19-4c39-90ea-f15b8409bf13 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:31.255327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e739c5-8b19-4c39-90ea-f15b8409bf13 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:31.255801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e739c5-8b19-4c39-90ea-f15b8409bf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:31.288972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-59e739c5-8b19-4c39-90ea-f15b8409bf13 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:31.290222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-59e739c5-8b19-4c39-90ea-f15b8409bf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:31.342464 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:31.357318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14480bdf-7853-426a-ad99-3f9bd28c4827 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:31.387622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:31.403944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59faf8c-142e-480c-92e2-ff9a3372ad9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:31.404796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59faf8c-142e-480c-92e2-ff9a3372ad9f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:31.405302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59faf8c-142e-480c-92e2-ff9a3372ad9f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:31.405722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59faf8c-142e-480c-92e2-ff9a3372ad9f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:31.407268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59faf8c-142e-480c-92e2-ff9a3372ad9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:31.407268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59faf8c-142e-480c-92e2-ff9a3372ad9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:31.409554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59faf8c-142e-480c-92e2-ff9a3372ad9f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:31.422998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 59/116] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:42:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:31.430931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59faf8c-142e-480c-92e2-ff9a3372ad9f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:31.437075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 58/117] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:31.448168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e95a7-0d60-4a80-a87c-38ada2cbdc0b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:31.448472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e95a7-0d60-4a80-a87c-38ada2cbdc0b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:31.448881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e95a7-0d60-4a80-a87c-38ada2cbdc0b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:31.455244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 59/118] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:31.473921 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cf8a-8dd1-4c25-bac6-0cfdf1c06335 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:31.474847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cf8a-8dd1-4c25-bac6-0cfdf1c06335 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:31.475307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047cf8a-8dd1-4c25-bac6-0cfdf1c06335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:31.499926 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e047cf8a-8dd1-4c25-bac6-0cfdf1c06335 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:31.501686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e047cf8a-8dd1-4c25-bac6-0cfdf1c06335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:31.595260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59faf8c-142e-480c-92e2-ff9a3372ad9f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:31.598852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 60/119] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:31.599843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cf8a-8dd1-4c25-bac6-0cfdf1c06335 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:31.641497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7c46-7492-4282-be13-969d6194f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:31.642499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7c46-7492-4282-be13-969d6194f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:31.643023 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7c46-7492-4282-be13-969d6194f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:31.643497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7c46-7492-4282-be13-969d6194f8d3 None admin] PATH_INFO: `/v3/users/92f50ac3a70a40c081782c0cf02c739f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:31.644920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba7c46-7492-4282-be13-969d6194f8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=92f50ac3a70a40c081782c0cf02c739f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:31.646642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba7c46-7492-4282-be13-969d6194f8d3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:31.648498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 60/120] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:31 2022] GET /identity/v3/users/92f50ac3a70a40c081782c0cf02c739f => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:31.655493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7c46-7492-4282-be13-969d6194f8d3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:31.692763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:31.780515 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047cf8a-8dd1-4c25-bac6-0cfdf1c06335 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:31.800647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7c46-7492-4282-be13-969d6194f8d3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:31.846168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:31.863700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17b96b-a049-4046-88b5-fccc2f36f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:31.864675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17b96b-a049-4046-88b5-fccc2f36f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:31.865155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17b96b-a049-4046-88b5-fccc2f36f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:31.865677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17b96b-a049-4046-88b5-fccc2f36f0c4 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:31.867104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17b96b-a049-4046-88b5-fccc2f36f0c4 None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:31.868832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17b96b-a049-4046-88b5-fccc2f36f0c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:31.870935 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 61/121] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:31 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:31.872467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17b96b-a049-4046-88b5-fccc2f36f0c4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:31.887277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6c96e-6b2c-4758-9021-0230d4487897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:31.887919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6c96e-6b2c-4758-9021-0230d4487897 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:31.888362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6c96e-6b2c-4758-9021-0230d4487897 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:31.888804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6c96e-6b2c-4758-9021-0230d4487897 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:31.899741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6c96e-6b2c-4758-9021-0230d4487897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-84f6c96e-6b2c-4758-9021-0230d4487897 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:31.905339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:31.906206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:31.906980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:31.909389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 61/122] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:31.910377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6c96e-6b2c-4758-9021-0230d4487897 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:32.008945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:32.022200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17b96b-a049-4046-88b5-fccc2f36f0c4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:32.040927 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6c96e-6b2c-4758-9021-0230d4487897 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:32.062986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce30c-b013-4c3e-85fc-bc43f97d0910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:32.063695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce30c-b013-4c3e-85fc-bc43f97d0910 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:32.064058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce30c-b013-4c3e-85fc-bc43f97d0910 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:32.064434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ce30c-b013-4c3e-85fc-bc43f97d0910 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:32.077696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ce30c-b013-4c3e-85fc-bc43f97d0910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:32.081254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b60ba1-5967-4827-9312-33859edb0162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:32.082148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60ba1-5967-4827-9312-33859edb0162 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:32.082622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60ba1-5967-4827-9312-33859edb0162 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-334ce30c-b013-4c3e-85fc-bc43f97d0910 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:32.083066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:32.083874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:32.084615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 62/123] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:32.085236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce30c-b013-4c3e-85fc-bc43f97d0910 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:32.085515 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b60ba1-5967-4827-9312-33859edb0162 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/users/92f50ac3a70a40c081782c0cf02c739f/roles/b622a13d8d0c4e4c832e8e3d20466938` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:32.087926 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b60ba1-5967-4827-9312-33859edb0162 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cef5622f4fc4c5d96c4ccb770698d16, user_id=92f50ac3a70a40c081782c0cf02c739f, role_id=b622a13d8d0c4e4c832e8e3d20466938)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:32.091200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b60ba1-5967-4827-9312-33859edb0162 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:32.165353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 62/124] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:42:31 2022] PUT /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/users/92f50ac3a70a40c081782c0cf02c739f/roles/b622a13d8d0c4e4c832e8e3d20466938 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:32.171504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b60ba1-5967-4827-9312-33859edb0162 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:32.198451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ce30c-b013-4c3e-85fc-bc43f97d0910 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:32.249839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:32.274792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ba560-aa48-4a6d-9368-79cf446efdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:32.275809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ba560-aa48-4a6d-9368-79cf446efdef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:32.276234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ba560-aa48-4a6d-9368-79cf446efdef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:32.276695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ba560-aa48-4a6d-9368-79cf446efdef None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:32.279896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ba560-aa48-4a6d-9368-79cf446efdef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:32.280403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ba560-aa48-4a6d-9368-79cf446efdef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:32.282057 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ba560-aa48-4a6d-9368-79cf446efdef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:32.296529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 63/125] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:32.300725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ba560-aa48-4a6d-9368-79cf446efdef None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:32.325059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:32.407509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b60ba1-5967-4827-9312-33859edb0162 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:32.448831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589785a1-2a81-45f2-b362-906e075d4113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:32.450389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589785a1-2a81-45f2-b362-906e075d4113 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:32.450874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589785a1-2a81-45f2-b362-906e075d4113 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:32.451338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589785a1-2a81-45f2-b362-906e075d4113 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:32.466300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589785a1-2a81-45f2-b362-906e075d4113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:32.468329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ba560-aa48-4a6d-9368-79cf446efdef None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-589785a1-2a81-45f2-b362-906e075d4113 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:32.473452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:32.474405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:32.475161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:32.477540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 63/126] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:32.478639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589785a1-2a81-45f2-b362-906e075d4113 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:32.506107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaf16d-5278-4c98-8a00-1b2d35d929aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:32.506746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf16d-5278-4c98-8a00-1b2d35d929aa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:32.507038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf16d-5278-4c98-8a00-1b2d35d929aa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:32.507321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf16d-5278-4c98-8a00-1b2d35d929aa None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:32.508022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaf16d-5278-4c98-8a00-1b2d35d929aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:32.509636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaf16d-5278-4c98-8a00-1b2d35d929aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:32.509748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaf16d-5278-4c98-8a00-1b2d35d929aa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:32.520361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 64/127] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:32.521188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaf16d-5278-4c98-8a00-1b2d35d929aa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:32.579975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:32.589197 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589785a1-2a81-45f2-b362-906e075d4113 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:32.625124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f7c5f-eb47-4c2f-bf37-db7682bbcb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:32.626074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f7c5f-eb47-4c2f-bf37-db7682bbcb2e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:32.626603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f7c5f-eb47-4c2f-bf37-db7682bbcb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:32.627172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f7c5f-eb47-4c2f-bf37-db7682bbcb2e None admin] PATH_INFO: `/v3/users/f4c8e66e98594150bb55f964ec327f0b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:32.627993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:32.635563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f7c5f-eb47-4c2f-bf37-db7682bbcb2e None admin] RBAC: Authorizing `identity:get_user(user_id=f4c8e66e98594150bb55f964ec327f0b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:32.637844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f7c5f-eb47-4c2f-bf37-db7682bbcb2e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:32.639750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 64/128] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:32 2022] GET /identity/v3/users/f4c8e66e98594150bb55f964ec327f0b => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:32.643140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f7c5f-eb47-4c2f-bf37-db7682bbcb2e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:32.682336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaf16d-5278-4c98-8a00-1b2d35d929aa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:32.735140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b20e6f-5363-481e-b0e7-eb0dbdafb5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:32.736630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b20e6f-5363-481e-b0e7-eb0dbdafb5fb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:32.736914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b20e6f-5363-481e-b0e7-eb0dbdafb5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:32.737191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b20e6f-5363-481e-b0e7-eb0dbdafb5fb None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:32.737876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b20e6f-5363-481e-b0e7-eb0dbdafb5fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:32.738868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b20e6f-5363-481e-b0e7-eb0dbdafb5fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:32.740272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b20e6f-5363-481e-b0e7-eb0dbdafb5fb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:32.757953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 65/129] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:32.764113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b20e6f-5363-481e-b0e7-eb0dbdafb5fb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:32.821137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f7c5f-eb47-4c2f-bf37-db7682bbcb2e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:32.913571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcc59f-16e4-4efb-951b-3b2ab946e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:32.914348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc59f-16e4-4efb-951b-3b2ab946e41a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:32.914555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc59f-16e4-4efb-951b-3b2ab946e41a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:32.914798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc59f-16e4-4efb-951b-3b2ab946e41a None admin] PATH_INFO: `/v3/users/92f50ac3a70a40c081782c0cf02c739f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:32.919677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcc59f-16e4-4efb-951b-3b2ab946e41a None admin] RBAC: Authorizing `identity:get_user(user_id=92f50ac3a70a40c081782c0cf02c739f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:32.922172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcc59f-16e4-4efb-951b-3b2ab946e41a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:32.923831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 65/130] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:32 2022] GET /identity/v3/users/92f50ac3a70a40c081782c0cf02c739f => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:32.924607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcc59f-16e4-4efb-951b-3b2ab946e41a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:32.960806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:32.988222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b20e6f-5363-481e-b0e7-eb0dbdafb5fb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:33.044233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcc59f-16e4-4efb-951b-3b2ab946e41a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:33.050613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf61c50-6058-429c-9022-90b6044e2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:33.051255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf61c50-6058-429c-9022-90b6044e2c7a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.051544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf61c50-6058-429c-9022-90b6044e2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.051826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf61c50-6058-429c-9022-90b6044e2c7a None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.059380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf61c50-6058-429c-9022-90b6044e2c7a None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:33.061136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf61c50-6058-429c-9022-90b6044e2c7a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:33.063055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 66/131] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:32 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:33.066251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf61c50-6058-429c-9022-90b6044e2c7a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:33.102575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:33.120371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2a2c9-d537-4e4d-942d-cc0e0e0d1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:33.120831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2a2c9-d537-4e4d-942d-cc0e0e0d1872 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.121117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2a2c9-d537-4e4d-942d-cc0e0e0d1872 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.121967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2a2c9-d537-4e4d-942d-cc0e0e0d1872 None admin] PATH_INFO: `/v3/users/92f50ac3a70a40c081782c0cf02c739f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.123143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2a2c9-d537-4e4d-942d-cc0e0e0d1872 None admin] RBAC: Authorizing `identity:get_user(user_id=92f50ac3a70a40c081782c0cf02c739f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:33.124808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2a2c9-d537-4e4d-942d-cc0e0e0d1872 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:33.130975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 66/132] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:32 2022] GET /identity/v3/users/92f50ac3a70a40c081782c0cf02c739f => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:33.132023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2a2c9-d537-4e4d-942d-cc0e0e0d1872 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:33.247637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf61c50-6058-429c-9022-90b6044e2c7a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:33.254146 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:33.268305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2a2c9-d537-4e4d-942d-cc0e0e0d1872 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:33.308708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca551a9-725e-4911-94cb-6bf85ad5f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:33.309942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca551a9-725e-4911-94cb-6bf85ad5f9ed None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.310267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca551a9-725e-4911-94cb-6bf85ad5f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.310551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca551a9-725e-4911-94cb-6bf85ad5f9ed None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.312898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca551a9-725e-4911-94cb-6bf85ad5f9ed None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:33.314454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca551a9-725e-4911-94cb-6bf85ad5f9ed None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:33.316251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 67/133] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:33 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:33.317063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca551a9-725e-4911-94cb-6bf85ad5f9ed None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:33.334387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb772e5-f920-48c3-aad5-4a202b0b75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:33.335077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb772e5-f920-48c3-aad5-4a202b0b75f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.335365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb772e5-f920-48c3-aad5-4a202b0b75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.335646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb772e5-f920-48c3-aad5-4a202b0b75f4 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/users/f4c8e66e98594150bb55f964ec327f0b/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.340218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb772e5-f920-48c3-aad5-4a202b0b75f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cef5622f4fc4c5d96c4ccb770698d16, user_id=f4c8e66e98594150bb55f964ec327f0b, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:33.341719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb772e5-f920-48c3-aad5-4a202b0b75f4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:33.407700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:33.441885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca551a9-725e-4911-94cb-6bf85ad5f9ed None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:33.477180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5449a-f503-47ef-99c5-7c9b42aa89c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:33.477824 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5449a-f503-47ef-99c5-7c9b42aa89c7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.478131 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5449a-f503-47ef-99c5-7c9b42aa89c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.478419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5449a-f503-47ef-99c5-7c9b42aa89c7 None admin] PATH_INFO: `/v3/projects/1282621234724b56b2d1fe16bc095bf6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.479568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5449a-f503-47ef-99c5-7c9b42aa89c7 None admin] RBAC: Authorizing `identity:get_project(project_id=1282621234724b56b2d1fe16bc095bf6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:33.481549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5449a-f503-47ef-99c5-7c9b42aa89c7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:33.486166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 68/134] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:33 2022] GET /identity/v3/projects/1282621234724b56b2d1fe16bc095bf6 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:33.486166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5449a-f503-47ef-99c5-7c9b42aa89c7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:33.497342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 67/135] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:42:33 2022] PUT /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/users/f4c8e66e98594150bb55f964ec327f0b/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:33.499640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0accf8f-9fe2-45ef-a231-d689962c6af0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.500138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0accf8f-9fe2-45ef-a231-d689962c6af0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.500680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0accf8f-9fe2-45ef-a231-d689962c6af0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.506661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 68/136] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:33.508061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0accf8f-9fe2-45ef-a231-d689962c6af0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:33.662417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5449a-f503-47ef-99c5-7c9b42aa89c7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:33.706392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89c7c2-9ddd-4ecd-a49c-402f10561875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:33.707510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89c7c2-9ddd-4ecd-a49c-402f10561875 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.707991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89c7c2-9ddd-4ecd-a49c-402f10561875 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.708465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89c7c2-9ddd-4ecd-a49c-402f10561875 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/users/92f50ac3a70a40c081782c0cf02c739f/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.711405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89c7c2-9ddd-4ecd-a49c-402f10561875 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cef5622f4fc4c5d96c4ccb770698d16, user_id=92f50ac3a70a40c081782c0cf02c739f, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:33.713277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89c7c2-9ddd-4ecd-a49c-402f10561875 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:33.717944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0accf8f-9fe2-45ef-a231-d689962c6af0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:33.756827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02abd42-1b0a-4eae-92a3-71274ce35732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:33.757475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02abd42-1b0a-4eae-92a3-71274ce35732 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.757764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02abd42-1b0a-4eae-92a3-71274ce35732 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.758044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02abd42-1b0a-4eae-92a3-71274ce35732 None admin] PATH_INFO: `/v3/projects/1282621234724b56b2d1fe16bc095bf6/users/92f50ac3a70a40c081782c0cf02c739f/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.759984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02abd42-1b0a-4eae-92a3-71274ce35732 None admin] RBAC: Authorizing `identity:create_grant(project_id=1282621234724b56b2d1fe16bc095bf6, user_id=92f50ac3a70a40c081782c0cf02c739f, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:33.761449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02abd42-1b0a-4eae-92a3-71274ce35732 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:33.786935 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:33.794794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 69/137] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:42:33 2022] PUT /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/users/92f50ac3a70a40c081782c0cf02c739f/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:33.796264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbc5a-e249-4a9d-9b5e-76bfb9d6bd18 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.796736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbc5a-e249-4a9d-9b5e-76bfb9d6bd18 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.797184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cbc5a-e249-4a9d-9b5e-76bfb9d6bd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.821751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-344cbc5a-e249-4a9d-9b5e-76bfb9d6bd18 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:33.823251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-344cbc5a-e249-4a9d-9b5e-76bfb9d6bd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:33.883245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 69/138] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:42:33 2022] PUT /identity/v3/projects/1282621234724b56b2d1fe16bc095bf6/users/92f50ac3a70a40c081782c0cf02c739f/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:33.884309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d17e2e-017e-4a15-a4ae-fb67c279344e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.884611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d17e2e-017e-4a15-a4ae-fb67c279344e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.890102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d17e2e-017e-4a15-a4ae-fb67c279344e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.891698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 70/139] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:33.899647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d5cb4-d8f8-41c2-9cd3-812d3c5898d7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:33.899951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d5cb4-d8f8-41c2-9cd3-812d3c5898d7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:33.900212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d5cb4-d8f8-41c2-9cd3-812d3c5898d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:33.915059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 70/140] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:33.943351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-259d5cb4-d8f8-41c2-9cd3-812d3c5898d7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:33.944612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-259d5cb4-d8f8-41c2-9cd3-812d3c5898d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:33.966979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:34.058652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 71/141] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:34.342440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbc5a-e249-4a9d-9b5e-76bfb9d6bd18 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:34.389258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d5cb4-d8f8-41c2-9cd3-812d3c5898d7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:34.518277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cbc5a-e249-4a9d-9b5e-76bfb9d6bd18 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:34.534116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d5cb4-d8f8-41c2-9cd3-812d3c5898d7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:34.579476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:34.589352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a3ea7-f26c-4333-b2a5-177853fdfd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:34.590636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a3ea7-f26c-4333-b2a5-177853fdfd49 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:34.590765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a3ea7-f26c-4333-b2a5-177853fdfd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:34.591046 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a3ea7-f26c-4333-b2a5-177853fdfd49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:34.599823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c5ba-9e68-45d8-b538-88e6aad42f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:34.600233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c5ba-9e68-45d8-b538-88e6aad42f6e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:34.600706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c5ba-9e68-45d8-b538-88e6aad42f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:34.601266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c5ba-9e68-45d8-b538-88e6aad42f6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:34.607294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c5ba-9e68-45d8-b538-88e6aad42f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:34.609045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c5ba-9e68-45d8-b538-88e6aad42f6e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:34.611330 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 72/142] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:34.615365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a3ea7-f26c-4333-b2a5-177853fdfd49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:34.616973 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c5ba-9e68-45d8-b538-88e6aad42f6e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9b3a3ea7-f26c-4333-b2a5-177853fdfd49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:34.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:34.621459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:34.622262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:34.626891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 71/143] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:34.629964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a3ea7-f26c-4333-b2a5-177853fdfd49 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:34.646459 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:34.790839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c5ba-9e68-45d8-b538-88e6aad42f6e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:34.841773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1a13b-dbcb-4259-a353-dab2d41ab283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:34.842814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1a13b-dbcb-4259-a353-dab2d41ab283 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:34.843244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1a13b-dbcb-4259-a353-dab2d41ab283 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:34.843666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1a13b-dbcb-4259-a353-dab2d41ab283 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:34.844595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1a13b-dbcb-4259-a353-dab2d41ab283 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:34.851723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1a13b-dbcb-4259-a353-dab2d41ab283 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:34.908289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a3ea7-f26c-4333-b2a5-177853fdfd49 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:34.960759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be01a1-9430-40a0-84a2-bd2aba15fba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:34.961388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be01a1-9430-40a0-84a2-bd2aba15fba4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:34.961675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be01a1-9430-40a0-84a2-bd2aba15fba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:34.961955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be01a1-9430-40a0-84a2-bd2aba15fba4 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:34.962674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be01a1-9430-40a0-84a2-bd2aba15fba4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:34.963040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be01a1-9430-40a0-84a2-bd2aba15fba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:34.964462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be01a1-9430-40a0-84a2-bd2aba15fba4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:34.976779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 73/144] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:42:34 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:34.978410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 72/145] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:34.985356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1a13b-dbcb-4259-a353-dab2d41ab283 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:35.047799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60482-f528-41d9-b5ea-191fe2d28925 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:35.048093 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60482-f528-41d9-b5ea-191fe2d28925 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:35.048375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60482-f528-41d9-b5ea-191fe2d28925 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:35.049779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 73/146] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:35.055476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62750657-889f-473c-8031-82903f0597aa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:35.055812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62750657-889f-473c-8031-82903f0597aa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:35.056104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62750657-889f-473c-8031-82903f0597aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:35.083108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-62750657-889f-473c-8031-82903f0597aa None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:35.084342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-62750657-889f-473c-8031-82903f0597aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:35.126453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:35.182651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:35.190678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1a13b-dbcb-4259-a353-dab2d41ab283 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:35.233010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 74/147] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:35.262532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5428fa-fe70-439d-806b-bc3e92268b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:35.263574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5428fa-fe70-439d-806b-bc3e92268b42 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:35.264056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5428fa-fe70-439d-806b-bc3e92268b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:35.264524 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5428fa-fe70-439d-806b-bc3e92268b42 None admin] PATH_INFO: `/v3/users/c2974f3438324963a16196f40a37d8f5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:35.265912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5428fa-fe70-439d-806b-bc3e92268b42 None admin] RBAC: Authorizing `identity:get_user(user_id=c2974f3438324963a16196f40a37d8f5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:35.267669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5428fa-fe70-439d-806b-bc3e92268b42 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:35.269460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 74/148] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:34 2022] GET /identity/v3/users/c2974f3438324963a16196f40a37d8f5 => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:35.275122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62750657-889f-473c-8031-82903f0597aa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:35.406119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62750657-889f-473c-8031-82903f0597aa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:35.441848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6bce1-9b61-49ce-bebd-d8470f235023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:35.442832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6bce1-9b61-49ce-bebd-d8470f235023 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:35.443310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6bce1-9b61-49ce-bebd-d8470f235023 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:35.443779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6bce1-9b61-49ce-bebd-d8470f235023 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:35.445122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6bce1-9b61-49ce-bebd-d8470f235023 None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:35.446890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6bce1-9b61-49ce-bebd-d8470f235023 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:35.448735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 75/149] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:35 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:35.455020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5428fa-fe70-439d-806b-bc3e92268b42 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:35.568718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5428fa-fe70-439d-806b-bc3e92268b42 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:35.604572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc203110-ce93-4931-b194-644fa514f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:35.605240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc203110-ce93-4931-b194-644fa514f3ec None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:35.605526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc203110-ce93-4931-b194-644fa514f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:35.605844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc203110-ce93-4931-b194-644fa514f3ec None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/users/c2974f3438324963a16196f40a37d8f5/roles/d9df243cfd5148769d90f26f275d55d6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:35.608439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc203110-ce93-4931-b194-644fa514f3ec None admin] RBAC: Authorizing `identity:create_grant(project_id=8cef5622f4fc4c5d96c4ccb770698d16, user_id=c2974f3438324963a16196f40a37d8f5, role_id=d9df243cfd5148769d90f26f275d55d6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:35.609154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6bce1-9b61-49ce-bebd-d8470f235023 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:35.609914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc203110-ce93-4931-b194-644fa514f3ec None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:35.669685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:35.724760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:35.728756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6bce1-9b61-49ce-bebd-d8470f235023 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:35.732104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 75/150] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:42:35 2022] PUT /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/users/c2974f3438324963a16196f40a37d8f5/roles/d9df243cfd5148769d90f26f275d55d6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:35.769675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eeab4-cc25-4ed1-8fb8-df3280835d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:35.770437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eeab4-cc25-4ed1-8fb8-df3280835d2d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:35.770717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eeab4-cc25-4ed1-8fb8-df3280835d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:35.771051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7eeab4-cc25-4ed1-8fb8-df3280835d2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:35.783571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7eeab4-cc25-4ed1-8fb8-df3280835d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7e7eeab4-cc25-4ed1-8fb8-df3280835d2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:35.789412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:35.790337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:35.791551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 76/151] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:42:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:42:35.796750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc203110-ce93-4931-b194-644fa514f3ec None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:35.925871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc203110-ce93-4931-b194-644fa514f3ec None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:35.970020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e2fe-4629-4c64-b74f-c349a45069bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:35.970672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e2fe-4629-4c64-b74f-c349a45069bd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:35.970956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e2fe-4629-4c64-b74f-c349a45069bd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:35.971230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e2fe-4629-4c64-b74f-c349a45069bd None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:35.971918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719e2fe-4629-4c64-b74f-c349a45069bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:35.972225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719e2fe-4629-4c64-b74f-c349a45069bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:35.973660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719e2fe-4629-4c64-b74f-c349a45069bd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:35.986826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 76/152] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:42:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:35.992749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eeab4-cc25-4ed1-8fb8-df3280835d2d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:36.122120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7eeab4-cc25-4ed1-8fb8-df3280835d2d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:36.131288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:36.158378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367e66e-3dbf-443d-94f5-99df07f4671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:36.159022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367e66e-3dbf-443d-94f5-99df07f4671f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:36.159305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367e66e-3dbf-443d-94f5-99df07f4671f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:36.159581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367e66e-3dbf-443d-94f5-99df07f4671f None admin] PATH_INFO: `/v3/users/92f50ac3a70a40c081782c0cf02c739f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:36.160740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367e66e-3dbf-443d-94f5-99df07f4671f None admin] RBAC: Authorizing `identity:get_user(user_id=92f50ac3a70a40c081782c0cf02c739f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:36.162573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367e66e-3dbf-443d-94f5-99df07f4671f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:36.164361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 77/153] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:35 2022] GET /identity/v3/users/92f50ac3a70a40c081782c0cf02c739f => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:36.170051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e2fe-4629-4c64-b74f-c349a45069bd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:36.272717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:36.335595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e2fe-4629-4c64-b74f-c349a45069bd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:36.384894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f361d9-7637-4492-933b-6af3745d5ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:36.385517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f361d9-7637-4492-933b-6af3745d5ebc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:36.385801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f361d9-7637-4492-933b-6af3745d5ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:36.386075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f361d9-7637-4492-933b-6af3745d5ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:36.469952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f361d9-7637-4492-933b-6af3745d5ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:36.471449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f361d9-7637-4492-933b-6af3745d5ebc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:36.559795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb54fa-8a5a-4636-aa2e-93ccd67435cb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:36.560274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb54fa-8a5a-4636-aa2e-93ccd67435cb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:36.560274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb54fa-8a5a-4636-aa2e-93ccd67435cb None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:36.561619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 78/154] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:36.569205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:36.569914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b211c-e68a-4364-a5bf-084f892a46ad None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:36.570229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b211c-e68a-4364-a5bf-084f892a46ad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:36.570508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b211c-e68a-4364-a5bf-084f892a46ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:36.603490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-369b211c-e68a-4364-a5bf-084f892a46ad None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:36.604693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-369b211c-e68a-4364-a5bf-084f892a46ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:36.664552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 77/155] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:36.678286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f361d9-7637-4492-933b-6af3745d5ebc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:36.716263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 79/156] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:36.828516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f361d9-7637-4492-933b-6af3745d5ebc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:36.868989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19230a6-b026-4f0a-9c13-4a1d7e8dca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:36.869653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19230a6-b026-4f0a-9c13-4a1d7e8dca2f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:36.869932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19230a6-b026-4f0a-9c13-4a1d7e8dca2f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:36.870238 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19230a6-b026-4f0a-9c13-4a1d7e8dca2f None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:36.872651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19230a6-b026-4f0a-9c13-4a1d7e8dca2f None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:36.874139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19230a6-b026-4f0a-9c13-4a1d7e8dca2f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:36.876112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 78/157] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:36 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:36.881713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b211c-e68a-4364-a5bf-084f892a46ad None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:37.007232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b211c-e68a-4364-a5bf-084f892a46ad None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:37.022641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:37.049077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a800b0-c1ad-4140-b095-7b236081f9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:37.049705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a800b0-c1ad-4140-b095-7b236081f9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:37.049987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a800b0-c1ad-4140-b095-7b236081f9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:37.050326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a800b0-c1ad-4140-b095-7b236081f9b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:37.051066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a800b0-c1ad-4140-b095-7b236081f9b5 None admin] RBAC: Adding query filter params (role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16, user.id=92f50ac3a70a40c081782c0cf02c739f) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:37.051430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a800b0-c1ad-4140-b095-7b236081f9b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:37.052898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a800b0-c1ad-4140-b095-7b236081f9b5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:37.059966 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 80/158] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:36 2022] GET /identity/v3/role_assignments?user.id=92f50ac3a70a40c081782c0cf02c739f&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:37.363974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19230a6-b026-4f0a-9c13-4a1d7e8dca2f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:37.393496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:37.479300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19230a6-b026-4f0a-9c13-4a1d7e8dca2f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:37.495874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597b7fe-1785-44e9-b3e8-ef8c5bea97f1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:37.496704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597b7fe-1785-44e9-b3e8-ef8c5bea97f1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:37.496977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597b7fe-1785-44e9-b3e8-ef8c5bea97f1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:37.498450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 81/159] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:37.503806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1cf44-5209-40ca-a4e5-44fb68b20697 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:37.504095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1cf44-5209-40ca-a4e5-44fb68b20697 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:37.504362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1cf44-5209-40ca-a4e5-44fb68b20697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:37.538329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a4b1cf44-5209-40ca-a4e5-44fb68b20697 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:37.539557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a4b1cf44-5209-40ca-a4e5-44fb68b20697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:37.552336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807d87d-a1f2-4186-a1a7-60b33133e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:37.552988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807d87d-a1f2-4186-a1a7-60b33133e0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:37.553272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807d87d-a1f2-4186-a1a7-60b33133e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:37.553555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807d87d-a1f2-4186-a1a7-60b33133e0b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:37.580105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807d87d-a1f2-4186-a1a7-60b33133e0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5807d87d-a1f2-4186-a1a7-60b33133e0b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:37.591041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:37.591957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:37.592831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:37.595068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 79/160] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:37.617135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807d87d-a1f2-4186-a1a7-60b33133e0b7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:37.691562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 82/161] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:37.727308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:37.741019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807d87d-a1f2-4186-a1a7-60b33133e0b7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:37.780416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188c1c0-2c76-4563-89eb-d4eb22e1041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:37.781087 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c1c0-2c76-4563-89eb-d4eb22e1041c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:37.781373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c1c0-2c76-4563-89eb-d4eb22e1041c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:37.781651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c1c0-2c76-4563-89eb-d4eb22e1041c None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:37.782361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188c1c0-2c76-4563-89eb-d4eb22e1041c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:37.782665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188c1c0-2c76-4563-89eb-d4eb22e1041c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:37.784125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188c1c0-2c76-4563-89eb-d4eb22e1041c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:37.798139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 80/162] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:37.803986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1cf44-5209-40ca-a4e5-44fb68b20697 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:37.913155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:37.916432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1cf44-5209-40ca-a4e5-44fb68b20697 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:37.963298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023828e-bd1d-466b-9043-93c23baf23b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:37.963948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023828e-bd1d-466b-9043-93c23baf23b2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:37.964233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023828e-bd1d-466b-9043-93c23baf23b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:37.964511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023828e-bd1d-466b-9043-93c23baf23b2 None admin] PATH_INFO: `/v3/users/f4c8e66e98594150bb55f964ec327f0b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:37.965915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023828e-bd1d-466b-9043-93c23baf23b2 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c8e66e98594150bb55f964ec327f0b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:37.967500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023828e-bd1d-466b-9043-93c23baf23b2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:37.969536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 83/163] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:37 2022] GET /identity/v3/users/f4c8e66e98594150bb55f964ec327f0b => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:37.975073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188c1c0-2c76-4563-89eb-d4eb22e1041c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:38.084986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188c1c0-2c76-4563-89eb-d4eb22e1041c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:38.115591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c07452-acaa-47d2-a806-2441f7f814ac None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:38.115907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c07452-acaa-47d2-a806-2441f7f814ac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:38.116150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c07452-acaa-47d2-a806-2441f7f814ac None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:38.117496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 84/164] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:38.122885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddddb1-ed4f-4ea5-b863-e59901efce5f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:38.123173 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddddb1-ed4f-4ea5-b863-e59901efce5f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:38.123515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddddb1-ed4f-4ea5-b863-e59901efce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:38.145073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-66ddddb1-ed4f-4ea5-b863-e59901efce5f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:38.147112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256a88c-c85f-41ff-9308-56ef71e05d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:38.147739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256a88c-c85f-41ff-9308-56ef71e05d3d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:38.148020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256a88c-c85f-41ff-9308-56ef71e05d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:38.148290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256a88c-c85f-41ff-9308-56ef71e05d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:38.154350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66ddddb1-ed4f-4ea5-b863-e59901efce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:38.177603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:38.260215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256a88c-c85f-41ff-9308-56ef71e05d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:38.261939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256a88c-c85f-41ff-9308-56ef71e05d3d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:38.276994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 85/165] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:38.389238 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 81/166] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:38.394333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddddb1-ed4f-4ea5-b863-e59901efce5f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:38.394544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256a88c-c85f-41ff-9308-56ef71e05d3d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:38.458552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:38.505108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256a88c-c85f-41ff-9308-56ef71e05d3d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:38.541603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bcc37-9704-4224-9b16-3d33bcae799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:38.542294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bcc37-9704-4224-9b16-3d33bcae799c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:38.542585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bcc37-9704-4224-9b16-3d33bcae799c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:38.542866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bcc37-9704-4224-9b16-3d33bcae799c None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:38.544599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bcc37-9704-4224-9b16-3d33bcae799c None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:38.546414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bcc37-9704-4224-9b16-3d33bcae799c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:38.548211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 82/167] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:38 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:38.554473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bcc37-9704-4224-9b16-3d33bcae799c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:38.603447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:38.612156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddddb1-ed4f-4ea5-b863-e59901efce5f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:38.665012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bcc37-9704-4224-9b16-3d33bcae799c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:38.678824 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c00e8-758c-4ac7-8243-89ba577d9257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:38.679492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c00e8-758c-4ac7-8243-89ba577d9257 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:38.679758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c00e8-758c-4ac7-8243-89ba577d9257 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:38.680031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c00e8-758c-4ac7-8243-89ba577d9257 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:38.695256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:38.700048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c00e8-758c-4ac7-8243-89ba577d9257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5b4c00e8-758c-4ac7-8243-89ba577d9257 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:38.705449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:38.721026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 86/168] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:38.721820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c00e8-758c-4ac7-8243-89ba577d9257 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:38.731401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665abe6a-a299-49a6-be6b-b9a6dbbe9b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:38.734649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665abe6a-a299-49a6-be6b-b9a6dbbe9b0c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:38.734934 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665abe6a-a299-49a6-be6b-b9a6dbbe9b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:38.735209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665abe6a-a299-49a6-be6b-b9a6dbbe9b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:38.736319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665abe6a-a299-49a6-be6b-b9a6dbbe9b0c None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16, user.id=f4c8e66e98594150bb55f964ec327f0b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:38.736637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665abe6a-a299-49a6-be6b-b9a6dbbe9b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:38.740183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665abe6a-a299-49a6-be6b-b9a6dbbe9b0c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:38.751689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 83/169] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:38 2022] GET /identity/v3/role_assignments?user.id=f4c8e66e98594150bb55f964ec327f0b&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:38.820015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665abe6a-a299-49a6-be6b-b9a6dbbe9b0c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:38.892546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c00e8-758c-4ac7-8243-89ba577d9257 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:38.959946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb8183-6064-4916-a4bf-6df4cb85a91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:38.960825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb8183-6064-4916-a4bf-6df4cb85a91f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:38.961247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb8183-6064-4916-a4bf-6df4cb85a91f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:38.961736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb8183-6064-4916-a4bf-6df4cb85a91f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:38.963144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb8183-6064-4916-a4bf-6df4cb85a91f None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:38.963620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb8183-6064-4916-a4bf-6df4cb85a91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:38.965768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb8183-6064-4916-a4bf-6df4cb85a91f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:38.976605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 87/170] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:38.984429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb8183-6064-4916-a4bf-6df4cb85a91f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:39.010421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:39.084403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665abe6a-a299-49a6-be6b-b9a6dbbe9b0c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:39.102644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb8183-6064-4916-a4bf-6df4cb85a91f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:39.143948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5108d-1c70-4417-8fb2-d09fbdb50603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:39.145029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5108d-1c70-4417-8fb2-d09fbdb50603 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:39.145525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5108d-1c70-4417-8fb2-d09fbdb50603 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:39.145993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5108d-1c70-4417-8fb2-d09fbdb50603 None admin] PATH_INFO: `/v3/users/92f50ac3a70a40c081782c0cf02c739f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:39.148201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5108d-1c70-4417-8fb2-d09fbdb50603 None admin] RBAC: Authorizing `identity:get_user(user_id=92f50ac3a70a40c081782c0cf02c739f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:39.149937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5108d-1c70-4417-8fb2-d09fbdb50603 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:39.151947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 88/171] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:38 2022] GET /identity/v3/users/92f50ac3a70a40c081782c0cf02c739f => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:39.160756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5108d-1c70-4417-8fb2-d09fbdb50603 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:39.167479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35630627-f4d4-454f-9aa2-8b6b42fdca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:39.168177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630627-f4d4-454f-9aa2-8b6b42fdca12 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:39.168463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630627-f4d4-454f-9aa2-8b6b42fdca12 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:39.168741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35630627-f4d4-454f-9aa2-8b6b42fdca12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:39.182008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35630627-f4d4-454f-9aa2-8b6b42fdca12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-35630627-f4d4-454f-9aa2-8b6b42fdca12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:39.187542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:39.188433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:39.189193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 84/172] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:42:39.195894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35630627-f4d4-454f-9aa2-8b6b42fdca12 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:39.279674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:39.338985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:39.360006 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5108d-1c70-4417-8fb2-d09fbdb50603 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:39.394609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35630627-f4d4-454f-9aa2-8b6b42fdca12 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:39.425753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9d031-908c-49c0-833c-144bbd5a7fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:39.426471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9d031-908c-49c0-833c-144bbd5a7fda None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:39.426765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9d031-908c-49c0-833c-144bbd5a7fda None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:39.427045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9d031-908c-49c0-833c-144bbd5a7fda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:39.442864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f8619-31a0-42ae-a5b2-fc7e02043713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:39.443474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f8619-31a0-42ae-a5b2-fc7e02043713 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:39.443758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f8619-31a0-42ae-a5b2-fc7e02043713 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:39.444026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f8619-31a0-42ae-a5b2-fc7e02043713 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:39.444809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f8619-31a0-42ae-a5b2-fc7e02043713 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:39.445114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f8619-31a0-42ae-a5b2-fc7e02043713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:39.446593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f8619-31a0-42ae-a5b2-fc7e02043713 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:39.456260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 85/173] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:39.457721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a340372-4048-4e7c-a85b-2fe4283d7cfd None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:39.458007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a340372-4048-4e7c-a85b-2fe4283d7cfd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:39.458309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a340372-4048-4e7c-a85b-2fe4283d7cfd None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:39.459533 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 86/174] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:39.462969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a340372-4048-4e7c-a85b-2fe4283d7cfd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:39.571719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9d031-908c-49c0-833c-144bbd5a7fda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:39.576324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9d031-908c-49c0-833c-144bbd5a7fda None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:39.623073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a340372-4048-4e7c-a85b-2fe4283d7cfd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:39.627041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:39.682836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b6106-e301-4dbf-8073-2e6338d6ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:39.684055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b6106-e301-4dbf-8073-2e6338d6ec45 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:39.685697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b6106-e301-4dbf-8073-2e6338d6ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:39.686212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b6106-e301-4dbf-8073-2e6338d6ec45 None admin] PATH_INFO: `/v3/users/92f50ac3a70a40c081782c0cf02c739f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:39.687856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b6106-e301-4dbf-8073-2e6338d6ec45 None admin] RBAC: Authorizing `identity:get_user(user_id=92f50ac3a70a40c081782c0cf02c739f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:39.689722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b6106-e301-4dbf-8073-2e6338d6ec45 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:39.691851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 87/175] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:39 2022] GET /identity/v3/users/92f50ac3a70a40c081782c0cf02c739f => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:39.693293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e63f2-713c-4eb8-b496-7c9e7e97d6d3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:39.693782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e63f2-713c-4eb8-b496-7c9e7e97d6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:39.694280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e63f2-713c-4eb8-b496-7c9e7e97d6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:39.714493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d42e63f2-713c-4eb8-b496-7c9e7e97d6d3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:39.716842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d42e63f2-713c-4eb8-b496-7c9e7e97d6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:39.758554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:39.781680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 89/176] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:42:39.782381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9d031-908c-49c0-833c-144bbd5a7fda None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:39.802690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 88/177] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:39.804024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e63f2-713c-4eb8-b496-7c9e7e97d6d3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:39.922000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e63f2-713c-4eb8-b496-7c9e7e97d6d3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:39.924037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:39.960980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca36f-bde6-435b-b1a4-1ed77103ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:39.961618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca36f-bde6-435b-b1a4-1ed77103ff6d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:39.961900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca36f-bde6-435b-b1a4-1ed77103ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:39.962193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca36f-bde6-435b-b1a4-1ed77103ff6d None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:39.963321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca36f-bde6-435b-b1a4-1ed77103ff6d None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:39.964964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca36f-bde6-435b-b1a4-1ed77103ff6d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:39.968584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 89/178] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:39 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:39.969868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573f428-8ff5-4b2b-b364-9611c4c10872 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:39.970224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573f428-8ff5-4b2b-b364-9611c4c10872 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:39.970498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573f428-8ff5-4b2b-b364-9611c4c10872 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:39.971837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 90/179] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:39.976608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573f428-8ff5-4b2b-b364-9611c4c10872 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:40.014731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9d031-908c-49c0-833c-144bbd5a7fda None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:40.049842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6e751-15d3-4295-80a4-d4f032e789f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:40.050496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6e751-15d3-4295-80a4-d4f032e789f9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.050782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6e751-15d3-4295-80a4-d4f032e789f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.051061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6e751-15d3-4295-80a4-d4f032e789f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.087110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573f428-8ff5-4b2b-b364-9611c4c10872 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:40.108978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:40.121178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6e751-15d3-4295-80a4-d4f032e789f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:40.125086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6e751-15d3-4295-80a4-d4f032e789f9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:40.126748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b07eb3-4564-4fa1-acf8-264fdb3eec82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:40.127573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07eb3-4564-4fa1-acf8-264fdb3eec82 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.128001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07eb3-4564-4fa1-acf8-264fdb3eec82 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.128428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07eb3-4564-4fa1-acf8-264fdb3eec82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.129342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b07eb3-4564-4fa1-acf8-264fdb3eec82 None admin] RBAC: Adding query filter params (role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16, user.id=92f50ac3a70a40c081782c0cf02c739f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:40.129803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b07eb3-4564-4fa1-acf8-264fdb3eec82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:40.131519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b07eb3-4564-4fa1-acf8-264fdb3eec82 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:40.138577 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 91/180] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:39 2022] GET /identity/v3/role_assignments?user.id=92f50ac3a70a40c081782c0cf02c739f&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=522cad34ce354f77b50e5490fdb6174d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:40.140124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdaeff-a4e7-4ca1-af7d-1a01490b0146 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.140547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdaeff-a4e7-4ca1-af7d-1a01490b0146 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.140957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdaeff-a4e7-4ca1-af7d-1a01490b0146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.163217 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5ecdaeff-a4e7-4ca1-af7d-1a01490b0146 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:40.164757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ecdaeff-a4e7-4ca1-af7d-1a01490b0146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:40.197252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:40.228776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 90/181] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:40.235157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6e751-15d3-4295-80a4-d4f032e789f9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:40.243529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 92/182] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:40.336395 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:40.355032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6e751-15d3-4295-80a4-d4f032e789f9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:40.361094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdaeff-a4e7-4ca1-af7d-1a01490b0146 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:40.448993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1a4ac-2ea1-4b1e-92cf-3a71463c75b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:40.449619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1a4ac-2ea1-4b1e-92cf-3a71463c75b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.449904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1a4ac-2ea1-4b1e-92cf-3a71463c75b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.450211 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1a4ac-2ea1-4b1e-92cf-3a71463c75b7 None admin] PATH_INFO: `/v3/projects/1282621234724b56b2d1fe16bc095bf6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.455027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1a4ac-2ea1-4b1e-92cf-3a71463c75b7 None admin] RBAC: Authorizing `identity:get_project(project_id=1282621234724b56b2d1fe16bc095bf6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:40.456565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1a4ac-2ea1-4b1e-92cf-3a71463c75b7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:40.458623 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 91/183] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:40 2022] GET /identity/v3/projects/1282621234724b56b2d1fe16bc095bf6 => generated 312 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:40.464608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1a4ac-2ea1-4b1e-92cf-3a71463c75b7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:40.572758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdaeff-a4e7-4ca1-af7d-1a01490b0146 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:40.610534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1a4ac-2ea1-4b1e-92cf-3a71463c75b7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:40.615177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7ec66-9ad6-4bb4-9881-f9ff64080b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:40.615821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7ec66-9ad6-4bb4-9881-f9ff64080b37 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.616101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7ec66-9ad6-4bb4-9881-f9ff64080b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.616371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7ec66-9ad6-4bb4-9881-f9ff64080b37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.627836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7ec66-9ad6-4bb4-9881-f9ff64080b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5db7ec66-9ad6-4bb4-9881-f9ff64080b37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:40.632801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:40.633710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:40.634532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 93/184] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:42:40.635424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13ca7-1317-4acc-a9ce-917e32606976 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.635708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13ca7-1317-4acc-a9ce-917e32606976 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.635986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13ca7-1317-4acc-a9ce-917e32606976 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.637761 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 94/185] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:40.639844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa13ca7-1317-4acc-a9ce-917e32606976 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:40.654290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147f9a8-3aa6-40ad-adcc-c3fd3be8a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:40.654907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147f9a8-3aa6-40ad-adcc-c3fd3be8a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.655195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147f9a8-3aa6-40ad-adcc-c3fd3be8a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.655470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147f9a8-3aa6-40ad-adcc-c3fd3be8a9a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.656222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147f9a8-3aa6-40ad-adcc-c3fd3be8a9a3 None admin] RBAC: Adding query filter params (role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=1282621234724b56b2d1fe16bc095bf6, user.id=92f50ac3a70a40c081782c0cf02c739f) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:40.656533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147f9a8-3aa6-40ad-adcc-c3fd3be8a9a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:40.658017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147f9a8-3aa6-40ad-adcc-c3fd3be8a9a3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:40.663774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 92/186] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:40 2022] GET /identity/v3/role_assignments?user.id=92f50ac3a70a40c081782c0cf02c739f&scope.project.id=1282621234724b56b2d1fe16bc095bf6&role.id=522cad34ce354f77b50e5490fdb6174d => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:40.664922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea9c4-2e24-4bfd-a705-12b09131534d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.665211 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea9c4-2e24-4bfd-a705-12b09131534d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.665492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea9c4-2e24-4bfd-a705-12b09131534d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.665665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:40.667108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 93/187] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:40.667484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea9c4-2e24-4bfd-a705-12b09131534d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:40.692998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:40.759337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa13ca7-1317-4acc-a9ce-917e32606976 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:40.788514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea9c4-2e24-4bfd-a705-12b09131534d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:40.799527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c85399-53b4-43a0-9399-10bf9a3bd775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:40.800259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c85399-53b4-43a0-9399-10bf9a3bd775 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.800461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c85399-53b4-43a0-9399-10bf9a3bd775 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.800720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c85399-53b4-43a0-9399-10bf9a3bd775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.812852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c85399-53b4-43a0-9399-10bf9a3bd775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c8c85399-53b4-43a0-9399-10bf9a3bd775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:40.817584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:40.818625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 95/188] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:42:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:40.825230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b948d-3530-4938-b71e-1d571442cf42 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.825940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b948d-3530-4938-b71e-1d571442cf42 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.825940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b948d-3530-4938-b71e-1d571442cf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.838393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3c4e6-6dcf-487b-a005-3bb8ba6ddd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:40.839008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3c4e6-6dcf-487b-a005-3bb8ba6ddd95 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.839292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3c4e6-6dcf-487b-a005-3bb8ba6ddd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.839565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3c4e6-6dcf-487b-a005-3bb8ba6ddd95 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.840800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3c4e6-6dcf-487b-a005-3bb8ba6ddd95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:40.841105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3c4e6-6dcf-487b-a005-3bb8ba6ddd95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:40.842598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3c4e6-6dcf-487b-a005-3bb8ba6ddd95 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:40.846718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0a7b948d-3530-4938-b71e-1d571442cf42 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:40.848561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0a7b948d-3530-4938-b71e-1d571442cf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:40.851703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 94/189] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:40.853058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f3760-9681-4997-9c50-9ef3cd5eb1f9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:40.853347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f3760-9681-4997-9c50-9ef3cd5eb1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:40.853620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f3760-9681-4997-9c50-9ef3cd5eb1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:40.874998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2c9f3760-9681-4997-9c50-9ef3cd5eb1f9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:40.877326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2c9f3760-9681-4997-9c50-9ef3cd5eb1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:40.925441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 96/190] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:40.930182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b948d-3530-4938-b71e-1d571442cf42 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:40.950920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:40.952607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 95/191] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:40.953507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f3760-9681-4997-9c50-9ef3cd5eb1f9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:40.968570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:41.042766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b948d-3530-4938-b71e-1d571442cf42 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.060701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f3760-9681-4997-9c50-9ef3cd5eb1f9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.083588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9e633-1744-40f0-b80a-1f4ba95d023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.085065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9e633-1744-40f0-b80a-1f4ba95d023a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.085662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9e633-1744-40f0-b80a-1f4ba95d023a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.086265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9e633-1744-40f0-b80a-1f4ba95d023a None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.087202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9e633-1744-40f0-b80a-1f4ba95d023a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:41.087690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9e633-1744-40f0-b80a-1f4ba95d023a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:41.089269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9e633-1744-40f0-b80a-1f4ba95d023a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:41.096181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc79826-0c92-4dca-bd89-f93904f29bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.096885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79826-0c92-4dca-bd89-f93904f29bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.097239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79826-0c92-4dca-bd89-f93904f29bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.097584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79826-0c92-4dca-bd89-f93904f29bb2 None admin] PATH_INFO: `/v3/users/c2974f3438324963a16196f40a37d8f5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.098812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc79826-0c92-4dca-bd89-f93904f29bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=c2974f3438324963a16196f40a37d8f5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:41.100336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc79826-0c92-4dca-bd89-f93904f29bb2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:41.100890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 97/192] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:41.106753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 96/193] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:40 2022] GET /identity/v3/users/c2974f3438324963a16196f40a37d8f5 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:41.107147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9e633-1744-40f0-b80a-1f4ba95d023a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:41.107792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc79826-0c92-4dca-bd89-f93904f29bb2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:41.195977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:41.208574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:41.226324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9e633-1744-40f0-b80a-1f4ba95d023a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.232088 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc79826-0c92-4dca-bd89-f93904f29bb2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.258037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7d8d-6189-46e7-b1ec-7aeb995b6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.258895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7d8d-6189-46e7-b1ec-7aeb995b6882 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.259184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7d8d-6189-46e7-b1ec-7aeb995b6882 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.259461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c7d8d-6189-46e7-b1ec-7aeb995b6882 None admin] PATH_INFO: `/v3/users/e1b2f888cd054ee9b9300e0f6df3679e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.265879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0cfb4-a128-470a-a619-c1f32a05cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.266556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0cfb4-a128-470a-a619-c1f32a05cb82 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.266832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0cfb4-a128-470a-a619-c1f32a05cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.267102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0cfb4-a128-470a-a619-c1f32a05cb82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.273284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c7d8d-6189-46e7-b1ec-7aeb995b6882 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b2f888cd054ee9b9300e0f6df3679e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:41.274868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c7d8d-6189-46e7-b1ec-7aeb995b6882 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:41.276497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 98/194] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:41 2022] GET /identity/v3/users/e1b2f888cd054ee9b9300e0f6df3679e => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:41.278243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7d8d-6189-46e7-b1ec-7aeb995b6882 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:41.336443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0cfb4-a128-470a-a619-c1f32a05cb82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:41.337843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0cfb4-a128-470a-a619-c1f32a05cb82 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:41.374536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c7d8d-6189-46e7-b1ec-7aeb995b6882 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.406777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042a13b-6652-4505-bdb6-6dd490e4d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.407398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042a13b-6652-4505-bdb6-6dd490e4d5be None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.407685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042a13b-6652-4505-bdb6-6dd490e4d5be None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.407961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042a13b-6652-4505-bdb6-6dd490e4d5be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.409079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042a13b-6652-4505-bdb6-6dd490e4d5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:41.410576 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042a13b-6652-4505-bdb6-6dd490e4d5be None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:41.412310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 99/195] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:41.413078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042a13b-6652-4505-bdb6-6dd490e4d5be None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:41.415540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:41.419620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:41.439551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 97/196] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:42:41.443204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0cfb4-a128-470a-a619-c1f32a05cb82 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:41.510714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042a13b-6652-4505-bdb6-6dd490e4d5be None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.540523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0cfb4-a128-470a-a619-c1f32a05cb82 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.543716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15412bf8-7147-4029-9df5-ad5426be1863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.544344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15412bf8-7147-4029-9df5-ad5426be1863 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.544626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15412bf8-7147-4029-9df5-ad5426be1863 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.544902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15412bf8-7147-4029-9df5-ad5426be1863 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.554628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15412bf8-7147-4029-9df5-ad5426be1863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-15412bf8-7147-4029-9df5-ad5426be1863 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:41.559971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:41.560998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 100/197] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:42:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:41.561971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15412bf8-7147-4029-9df5-ad5426be1863 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:41.576558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f90bc-f50f-4989-885f-b8f5a5e73ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.577168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f90bc-f50f-4989-885f-b8f5a5e73ecb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.577450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f90bc-f50f-4989-885f-b8f5a5e73ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.577724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f90bc-f50f-4989-885f-b8f5a5e73ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.620436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:41.624420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:41.642716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f90bc-f50f-4989-885f-b8f5a5e73ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:41.644194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f90bc-f50f-4989-885f-b8f5a5e73ecb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:41.657545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15412bf8-7147-4029-9df5-ad5426be1863 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.690318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc642a-ae34-4165-9c41-0ec7c53d1690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.690917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc642a-ae34-4165-9c41-0ec7c53d1690 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.691198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc642a-ae34-4165-9c41-0ec7c53d1690 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.691471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc642a-ae34-4165-9c41-0ec7c53d1690 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.692118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc642a-ae34-4165-9c41-0ec7c53d1690 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:41.693542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc642a-ae34-4165-9c41-0ec7c53d1690 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:41.741448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 98/198] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:41.742325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f90bc-f50f-4989-885f-b8f5a5e73ecb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:41.799787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 101/199] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:42:41 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:41.800613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc642a-ae34-4165-9c41-0ec7c53d1690 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:41.839693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:41.860644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f90bc-f50f-4989-885f-b8f5a5e73ecb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.899004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8f065-706a-402c-a0cb-69b5ae736a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.899686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8f065-706a-402c-a0cb-69b5ae736a5e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.900032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8f065-706a-402c-a0cb-69b5ae736a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.900369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8f065-706a-402c-a0cb-69b5ae736a5e None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.901627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8f065-706a-402c-a0cb-69b5ae736a5e None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:41.903797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8f065-706a-402c-a0cb-69b5ae736a5e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:41.905600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 99/200] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:41 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:41.911239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8f065-706a-402c-a0cb-69b5ae736a5e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:41.917737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc642a-ae34-4165-9c41-0ec7c53d1690 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:41.944254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:41.962379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de73065-d23d-4376-875c-55630802ed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:41.963153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73065-d23d-4376-875c-55630802ed28 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:41.963436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73065-d23d-4376-875c-55630802ed28 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:41.963708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de73065-d23d-4376-875c-55630802ed28 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:41.964391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de73065-d23d-4376-875c-55630802ed28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:41.965219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de73065-d23d-4376-875c-55630802ed28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:41.966660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de73065-d23d-4376-875c-55630802ed28 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:41.976380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 102/201] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:42:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:41.983772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de73065-d23d-4376-875c-55630802ed28 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:42.029116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8f065-706a-402c-a0cb-69b5ae736a5e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:42.068634 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8f165-a0ee-4aaf-b2f0-742a3b33393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:42.069272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f165-a0ee-4aaf-b2f0-742a3b33393e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:42.069554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f165-a0ee-4aaf-b2f0-742a3b33393e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:42.069827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f165-a0ee-4aaf-b2f0-742a3b33393e None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:42.071038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8f165-a0ee-4aaf-b2f0-742a3b33393e None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:42.072541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8f165-a0ee-4aaf-b2f0-742a3b33393e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:42.074252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 100/202] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:41 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:42.075025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8f165-a0ee-4aaf-b2f0-742a3b33393e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:42.097418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:42.099843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de73065-d23d-4376-875c-55630802ed28 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:42.143695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0fe0d-c7e2-4461-b05e-815a065a1180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:42.144453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0fe0d-c7e2-4461-b05e-815a065a1180 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:42.144907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0fe0d-c7e2-4461-b05e-815a065a1180 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:42.145209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0fe0d-c7e2-4461-b05e-815a065a1180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:42.146610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0fe0d-c7e2-4461-b05e-815a065a1180 None admin] RBAC: Adding query filter params (role.id=d9df243cfd5148769d90f26f275d55d6, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16, user.id=c2974f3438324963a16196f40a37d8f5) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:42.147127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0fe0d-c7e2-4461-b05e-815a065a1180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:42.148961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0fe0d-c7e2-4461-b05e-815a065a1180 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:42.156088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 103/203] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:41 2022] GET /identity/v3/role_assignments?user.id=c2974f3438324963a16196f40a37d8f5&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=d9df243cfd5148769d90f26f275d55d6 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:42.157022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0fe0d-c7e2-4461-b05e-815a065a1180 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:42.214070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:42.227441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8f165-a0ee-4aaf-b2f0-742a3b33393e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:42.280664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108bc0d-f91b-4eff-ba8d-d5f9d7393e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:42.281576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108bc0d-f91b-4eff-ba8d-d5f9d7393e7d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:42.282008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108bc0d-f91b-4eff-ba8d-d5f9d7393e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:42.282457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108bc0d-f91b-4eff-ba8d-d5f9d7393e7d None admin] PATH_INFO: `/v3/users/e1b2f888cd054ee9b9300e0f6df3679e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:42.282655 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0fe0d-c7e2-4461-b05e-815a065a1180 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:42.284015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108bc0d-f91b-4eff-ba8d-d5f9d7393e7d None admin] RBAC: Authorizing `identity:get_user(user_id=e1b2f888cd054ee9b9300e0f6df3679e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:42.286870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108bc0d-f91b-4eff-ba8d-d5f9d7393e7d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:42.289974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 101/204] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:42 2022] GET /identity/v3/users/e1b2f888cd054ee9b9300e0f6df3679e => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:42.295923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108bc0d-f91b-4eff-ba8d-d5f9d7393e7d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:42.323612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebcb7f-b656-4fc3-b599-ef85657bf11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:42.324776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebcb7f-b656-4fc3-b599-ef85657bf11a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:42.325058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebcb7f-b656-4fc3-b599-ef85657bf11a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:42.325328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebcb7f-b656-4fc3-b599-ef85657bf11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:42.326099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebcb7f-b656-4fc3-b599-ef85657bf11a None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=2128b23359fb4df3954335bb9c1edc4e, user.id=e1b2f888cd054ee9b9300e0f6df3679e) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:42.326420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebcb7f-b656-4fc3-b599-ef85657bf11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:42.327883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebcb7f-b656-4fc3-b599-ef85657bf11a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:42.334368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 104/205] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:42 2022] GET /identity/v3/role_assignments?user.id=e1b2f888cd054ee9b9300e0f6df3679e&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:42.431196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:42.461486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108bc0d-f91b-4eff-ba8d-d5f9d7393e7d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:42.520156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03444c9-f9de-4072-89c7-fb02b266f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:42.520772 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03444c9-f9de-4072-89c7-fb02b266f4df None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:42.521050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03444c9-f9de-4072-89c7-fb02b266f4df None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:42.521319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03444c9-f9de-4072-89c7-fb02b266f4df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:42.592540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03444c9-f9de-4072-89c7-fb02b266f4df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:42.594015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03444c9-f9de-4072-89c7-fb02b266f4df None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:42.680912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:42.698596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 102/206] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:42.704887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebcb7f-b656-4fc3-b599-ef85657bf11a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:42.848241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebcb7f-b656-4fc3-b599-ef85657bf11a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:42.858529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:42.886436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc861e5-f6e4-4ef4-b4cb-f987f909d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:42.887265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc861e5-f6e4-4ef4-b4cb-f987f909d8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:42.887642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc861e5-f6e4-4ef4-b4cb-f987f909d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:42.888019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc861e5-f6e4-4ef4-b4cb-f987f909d8b6 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:42.889275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc861e5-f6e4-4ef4-b4cb-f987f909d8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:42.890849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc861e5-f6e4-4ef4-b4cb-f987f909d8b6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:42.892597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 105/207] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:42 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:42.898865 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03444c9-f9de-4072-89c7-fb02b266f4df None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:43.005354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03444c9-f9de-4072-89c7-fb02b266f4df None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:43.041716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b6aef-4ed0-48ea-b375-2a31b2417b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:43.042551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b6aef-4ed0-48ea-b375-2a31b2417b4a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:43.042962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b6aef-4ed0-48ea-b375-2a31b2417b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:43.043330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b6aef-4ed0-48ea-b375-2a31b2417b4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:43.044258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b6aef-4ed0-48ea-b375-2a31b2417b4a None admin] RBAC: Adding query filter params (role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=2128b23359fb4df3954335bb9c1edc4e, user.id=e1b2f888cd054ee9b9300e0f6df3679e) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:43.044673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b6aef-4ed0-48ea-b375-2a31b2417b4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:43.046337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b6aef-4ed0-48ea-b375-2a31b2417b4a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:43.053040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 103/208] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:42 2022] GET /identity/v3/role_assignments?user.id=e1b2f888cd054ee9b9300e0f6df3679e&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:44.193004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242853b-5565-45d2-a034-4f2ea6330b75 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:44.193495 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242853b-5565-45d2-a034-4f2ea6330b75 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:44.193495 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242853b-5565-45d2-a034-4f2ea6330b75 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:44.195107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 106/209] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:44.200992 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328448dd-bcb2-424b-bbe9-8e0b68d06e6b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:44.201395 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328448dd-bcb2-424b-bbe9-8e0b68d06e6b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:44.201562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328448dd-bcb2-424b-bbe9-8e0b68d06e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:44.220435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-328448dd-bcb2-424b-bbe9-8e0b68d06e6b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:44.221658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-328448dd-bcb2-424b-bbe9-8e0b68d06e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:44.273760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:44.298790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 104/210] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:44.354714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a61ce2-31db-4d2a-a4c1-23d4b3904748 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:44.355004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a61ce2-31db-4d2a-a4c1-23d4b3904748 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:44.355884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a61ce2-31db-4d2a-a4c1-23d4b3904748 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:44.357844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 107/211] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:44.362794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516c70a-edce-41c1-9f9a-5fb6c3a42345 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:44.363093 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516c70a-edce-41c1-9f9a-5fb6c3a42345 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:44.363377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516c70a-edce-41c1-9f9a-5fb6c3a42345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:44.381373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d516c70a-edce-41c1-9f9a-5fb6c3a42345 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:44.382665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d516c70a-edce-41c1-9f9a-5fb6c3a42345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:44.449601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 105/212] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:44.576405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a61ce2-31db-4d2a-a4c1-23d4b3904748 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:44.587142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5fd60-c753-4e1e-be45-6ca37d936553 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:44.587434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5fd60-c753-4e1e-be45-6ca37d936553 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:44.587719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5fd60-c753-4e1e-be45-6ca37d936553 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:44.589079 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 106/213] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:44.594022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081804-ead1-4cf3-85ad-2542140dd483 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:44.594347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081804-ead1-4cf3-85ad-2542140dd483 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:44.594630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081804-ead1-4cf3-85ad-2542140dd483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:44.616871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8b081804-ead1-4cf3-85ad-2542140dd483 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:44.618073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b081804-ead1-4cf3-85ad-2542140dd483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:44.687439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 107/214] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:44.687760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a61ce2-31db-4d2a-a4c1-23d4b3904748 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:44.734383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba814f-176e-4e1f-8754-301f5071c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:44.734985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba814f-176e-4e1f-8754-301f5071c264 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:44.735266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba814f-176e-4e1f-8754-301f5071c264 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:44.735632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba814f-176e-4e1f-8754-301f5071c264 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:44.746745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba814f-176e-4e1f-8754-301f5071c264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:44.747029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081804-ead1-4cf3-85ad-2542140dd483 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-cfba814f-176e-4e1f-8754-301f5071c264 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:44.752104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:44.752986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:44.753779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 108/215] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:44.759690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba814f-176e-4e1f-8754-301f5071c264 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:44.795740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:44.801052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:44.864947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba814f-176e-4e1f-8754-301f5071c264 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:44.884002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081804-ead1-4cf3-85ad-2542140dd483 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:44.907014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc8421-9be0-4546-8744-552991c3e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:44.907987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc8421-9be0-4546-8744-552991c3e316 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:44.908516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc8421-9be0-4546-8744-552991c3e316 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:44.908997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc8421-9be0-4546-8744-552991c3e316 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:44.909861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc8421-9be0-4546-8744-552991c3e316 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:44.910404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc8421-9be0-4546-8744-552991c3e316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:44.911984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc8421-9be0-4546-8744-552991c3e316 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:44.923012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 109/216] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:44.931272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc8421-9be0-4546-8744-552991c3e316 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:44.954104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75251029-3d9c-45c2-b591-2d1c29fd8bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:44.954104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75251029-3d9c-45c2-b591-2d1c29fd8bfc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:44.954104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75251029-3d9c-45c2-b591-2d1c29fd8bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:44.954104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75251029-3d9c-45c2-b591-2d1c29fd8bfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:44.954530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75251029-3d9c-45c2-b591-2d1c29fd8bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:44.954612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75251029-3d9c-45c2-b591-2d1c29fd8bfc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:44.956474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 108/217] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:44.961944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75251029-3d9c-45c2-b591-2d1c29fd8bfc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:45.045382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:45.049639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc8421-9be0-4546-8744-552991c3e316 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:45.067258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75251029-3d9c-45c2-b591-2d1c29fd8bfc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:45.074354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:45.087109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98223a-fcc6-4570-b9df-e355a93a8e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:45.087972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98223a-fcc6-4570-b9df-e355a93a8e14 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.088254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98223a-fcc6-4570-b9df-e355a93a8e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.088526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98223a-fcc6-4570-b9df-e355a93a8e14 None admin] PATH_INFO: `/v3/users/e691bb1d10224a65b56b0b7b8614d749` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.102806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98223a-fcc6-4570-b9df-e355a93a8e14 None admin] RBAC: Authorizing `identity:get_user(user_id=e691bb1d10224a65b56b0b7b8614d749)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:45.104511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebb0a4-f7d2-4691-8edf-16fd2ad93a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:45.104659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98223a-fcc6-4570-b9df-e355a93a8e14 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:45.105155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebb0a4-f7d2-4691-8edf-16fd2ad93a5f None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.105959 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebb0a4-f7d2-4691-8edf-16fd2ad93a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.106515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebb0a4-f7d2-4691-8edf-16fd2ad93a5f None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.111598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 110/218] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:44 2022] GET /identity/v3/users/e691bb1d10224a65b56b0b7b8614d749 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:45.111850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebb0a4-f7d2-4691-8edf-16fd2ad93a5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:45.111945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98223a-fcc6-4570-b9df-e355a93a8e14 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:45.112028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebb0a4-f7d2-4691-8edf-16fd2ad93a5f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:45.209938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98223a-fcc6-4570-b9df-e355a93a8e14 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:45.218474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 109/219] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:42:44 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:42:45.219260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebb0a4-f7d2-4691-8edf-16fd2ad93a5f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:45.260714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b937-c1e0-4f51-86d0-1d46eabf5a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:45.262479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b937-c1e0-4f51-86d0-1d46eabf5a7b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.263193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b937-c1e0-4f51-86d0-1d46eabf5a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.263672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b937-c1e0-4f51-86d0-1d46eabf5a7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.278402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789b937-c1e0-4f51-86d0-1d46eabf5a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6789b937-c1e0-4f51-86d0-1d46eabf5a7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:45.284075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:45.285190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:45.286006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 111/220] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:42:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:45.286899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000b9e5-9daf-4ac7-8caa-4630e60c91e9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.287252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000b9e5-9daf-4ac7-8caa-4630e60c91e9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.287448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000b9e5-9daf-4ac7-8caa-4630e60c91e9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.288770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 112/221] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:45.296068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184092b-6f66-46c4-8303-02445ca32e88 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.296367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184092b-6f66-46c4-8303-02445ca32e88 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.296661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184092b-6f66-46c4-8303-02445ca32e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.315913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d184092b-6f66-46c4-8303-02445ca32e88 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:45.317357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d184092b-6f66-46c4-8303-02445ca32e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:45.329826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:45.350114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebb0a4-f7d2-4691-8edf-16fd2ad93a5f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:45.385022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6e5e5-d185-4101-b52c-8758272ef6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:45.385650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e5e5-d185-4101-b52c-8758272ef6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.385936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e5e5-d185-4101-b52c-8758272ef6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.386246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e5e5-d185-4101-b52c-8758272ef6c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.393734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 113/222] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:45.394643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184092b-6f66-46c4-8303-02445ca32e88 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:45.421220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:45.471891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6e5e5-d185-4101-b52c-8758272ef6c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:45.473555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6e5e5-d185-4101-b52c-8758272ef6c5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:45.513683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184092b-6f66-46c4-8303-02445ca32e88 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:45.555032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f89982-64da-4ec9-9d75-820bc43e31f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:45.556068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f89982-64da-4ec9-9d75-820bc43e31f3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.556585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f89982-64da-4ec9-9d75-820bc43e31f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.557045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f89982-64da-4ec9-9d75-820bc43e31f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.557918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f89982-64da-4ec9-9d75-820bc43e31f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:45.558473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f89982-64da-4ec9-9d75-820bc43e31f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:45.560320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f89982-64da-4ec9-9d75-820bc43e31f3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:45.570221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 114/223] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:45.575656 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f89982-64da-4ec9-9d75-820bc43e31f3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:45.589029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:45.602638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 110/224] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:45.608858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6e5e5-d185-4101-b52c-8758272ef6c5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:45.696640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:45.711894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f89982-64da-4ec9-9d75-820bc43e31f3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:45.747763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6e5e5-d185-4101-b52c-8758272ef6c5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:45.752489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f63f-f5f7-42ed-9301-9220d32cb777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:45.753195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f63f-f5f7-42ed-9301-9220d32cb777 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.753518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f63f-f5f7-42ed-9301-9220d32cb777 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.753800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f63f-f5f7-42ed-9301-9220d32cb777 None admin] PATH_INFO: `/v3/users/e1b2f888cd054ee9b9300e0f6df3679e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.755153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f63f-f5f7-42ed-9301-9220d32cb777 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b2f888cd054ee9b9300e0f6df3679e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:45.756617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f63f-f5f7-42ed-9301-9220d32cb777 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:45.758773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 115/225] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:45 2022] GET /identity/v3/users/e1b2f888cd054ee9b9300e0f6df3679e => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:45.759661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f63f-f5f7-42ed-9301-9220d32cb777 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:45.784857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9101cd-01bb-4108-b87d-e11b4e903154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:45.785497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9101cd-01bb-4108-b87d-e11b4e903154 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.785779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9101cd-01bb-4108-b87d-e11b4e903154 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.786094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9101cd-01bb-4108-b87d-e11b4e903154 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.787479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9101cd-01bb-4108-b87d-e11b4e903154 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:45.788933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9101cd-01bb-4108-b87d-e11b4e903154 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:45.791115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 111/226] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:45 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:45.791925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9101cd-01bb-4108-b87d-e11b4e903154 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:45.841638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:45.873000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f63f-f5f7-42ed-9301-9220d32cb777 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:45.915121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47044508-4d4c-4257-a51c-bf5d8617c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:45.916802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47044508-4d4c-4257-a51c-bf5d8617c00a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:45.917313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47044508-4d4c-4257-a51c-bf5d8617c00a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:45.918554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47044508-4d4c-4257-a51c-bf5d8617c00a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:45.938610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47044508-4d4c-4257-a51c-bf5d8617c00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-47044508-4d4c-4257-a51c-bf5d8617c00a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:45.945675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:45.946573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:45.947347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:45.949748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 116/227] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:42:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:45.955094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47044508-4d4c-4257-a51c-bf5d8617c00a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:45.968958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9101cd-01bb-4108-b87d-e11b4e903154 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:46.006532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:46.010638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12250ca1-c035-42c9-8fa4-6f3ead553d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:46.011740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12250ca1-c035-42c9-8fa4-6f3ead553d01 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:46.012096 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12250ca1-c035-42c9-8fa4-6f3ead553d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:46.012451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12250ca1-c035-42c9-8fa4-6f3ead553d01 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:46.013723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12250ca1-c035-42c9-8fa4-6f3ead553d01 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:46.015480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12250ca1-c035-42c9-8fa4-6f3ead553d01 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:46.017480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 112/228] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:45 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:46.018360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12250ca1-c035-42c9-8fa4-6f3ead553d01 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:46.084034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47044508-4d4c-4257-a51c-bf5d8617c00a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:46.124501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476490b-1b55-46dd-a8cd-429e2ddcb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:46.125104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476490b-1b55-46dd-a8cd-429e2ddcb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:46.125716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476490b-1b55-46dd-a8cd-429e2ddcb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:46.125716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476490b-1b55-46dd-a8cd-429e2ddcb9a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:46.126542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476490b-1b55-46dd-a8cd-429e2ddcb9a5 None admin] RBAC: Adding query filter params (role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=2128b23359fb4df3954335bb9c1edc4e, user.id=e691bb1d10224a65b56b0b7b8614d749) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:46.126855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476490b-1b55-46dd-a8cd-429e2ddcb9a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:46.128386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476490b-1b55-46dd-a8cd-429e2ddcb9a5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:46.131814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:46.135322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 117/229] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:45 2022] GET /identity/v3/role_assignments?user.id=e691bb1d10224a65b56b0b7b8614d749&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=522cad34ce354f77b50e5490fdb6174d => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:46.143498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476490b-1b55-46dd-a8cd-429e2ddcb9a5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:46.154629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12250ca1-c035-42c9-8fa4-6f3ead553d01 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:46.199673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3b69f-6f97-420e-bdf5-31adca163090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:46.200993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b69f-6f97-420e-bdf5-31adca163090 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:46.201523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b69f-6f97-420e-bdf5-31adca163090 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:46.202216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3b69f-6f97-420e-bdf5-31adca163090 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:46.203172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3b69f-6f97-420e-bdf5-31adca163090 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:46.204128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3b69f-6f97-420e-bdf5-31adca163090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:46.205783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3b69f-6f97-420e-bdf5-31adca163090 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:46.217721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 113/230] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:42:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:46.223223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3b69f-6f97-420e-bdf5-31adca163090 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:46.362233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:46.369571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476490b-1b55-46dd-a8cd-429e2ddcb9a5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:46.407456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309318ef-a477-44df-90e5-ba9d18498d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:46.408060 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309318ef-a477-44df-90e5-ba9d18498d7c None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:46.408342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309318ef-a477-44df-90e5-ba9d18498d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:46.408652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309318ef-a477-44df-90e5-ba9d18498d7c None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e/users/e1b2f888cd054ee9b9300e0f6df3679e/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:46.410668 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309318ef-a477-44df-90e5-ba9d18498d7c None admin] RBAC: Authorizing `identity:create_grant(project_id=2128b23359fb4df3954335bb9c1edc4e, user_id=e1b2f888cd054ee9b9300e0f6df3679e, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:46.412540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309318ef-a477-44df-90e5-ba9d18498d7c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:46.424359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3b69f-6f97-420e-bdf5-31adca163090 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:46.466322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f2851-1aca-4aa4-8540-e35a10e88f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:46.466962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f2851-1aca-4aa4-8540-e35a10e88f7c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:46.467245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f2851-1aca-4aa4-8540-e35a10e88f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:46.467520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f2851-1aca-4aa4-8540-e35a10e88f7c None admin] PATH_INFO: `/v3/users/e1b2f888cd054ee9b9300e0f6df3679e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:46.468737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f2851-1aca-4aa4-8540-e35a10e88f7c None admin] RBAC: Authorizing `identity:get_user(user_id=e1b2f888cd054ee9b9300e0f6df3679e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:46.470389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f2851-1aca-4aa4-8540-e35a10e88f7c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:46.473067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 114/231] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:46 2022] GET /identity/v3/users/e1b2f888cd054ee9b9300e0f6df3679e => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:46.479141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f2851-1aca-4aa4-8540-e35a10e88f7c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:46.495407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 118/232] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:42:46 2022] PUT /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e/users/e1b2f888cd054ee9b9300e0f6df3679e/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:46.614425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f2851-1aca-4aa4-8540-e35a10e88f7c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:46.649771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:46.664912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7116bf-a89f-4d01-acbc-03381161d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:46.664912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7116bf-a89f-4d01-acbc-03381161d933 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:46.664912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7116bf-a89f-4d01-acbc-03381161d933 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:46.664912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7116bf-a89f-4d01-acbc-03381161d933 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:46.665347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7116bf-a89f-4d01-acbc-03381161d933 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:46.665957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7116bf-a89f-4d01-acbc-03381161d933 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:46.668037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 115/233] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:46 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:46.674606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309318ef-a477-44df-90e5-ba9d18498d7c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:46.758803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:46.801525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309318ef-a477-44df-90e5-ba9d18498d7c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:46.836407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea3d55-c8f5-493b-9349-fb5ed02eda78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:46.837369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3d55-c8f5-493b-9349-fb5ed02eda78 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:46.837792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3d55-c8f5-493b-9349-fb5ed02eda78 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:46.838234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea3d55-c8f5-493b-9349-fb5ed02eda78 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e/users/e1b2f888cd054ee9b9300e0f6df3679e/roles/b622a13d8d0c4e4c832e8e3d20466938` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:46.840605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea3d55-c8f5-493b-9349-fb5ed02eda78 None admin] RBAC: Authorizing `identity:create_grant(project_id=2128b23359fb4df3954335bb9c1edc4e, user_id=e1b2f888cd054ee9b9300e0f6df3679e, role_id=b622a13d8d0c4e4c832e8e3d20466938)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:46.842235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea3d55-c8f5-493b-9349-fb5ed02eda78 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:46.962673 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 119/234] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:42:46 2022] PUT /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e/users/e1b2f888cd054ee9b9300e0f6df3679e/roles/b622a13d8d0c4e4c832e8e3d20466938 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:47.869760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dde04-8c5a-4bb5-b6c3-9d9eb8345285 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:47.870329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dde04-8c5a-4bb5-b6c3-9d9eb8345285 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:47.870433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dde04-8c5a-4bb5-b6c3-9d9eb8345285 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:47.871957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 116/235] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:47.877523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c28d5a-f97a-4658-84a5-abf6cf1cbbaa None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:47.878378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c28d5a-f97a-4658-84a5-abf6cf1cbbaa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:47.878851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c28d5a-f97a-4658-84a5-abf6cf1cbbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:47.897360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-94c28d5a-f97a-4658-84a5-abf6cf1cbbaa None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:47.898967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94c28d5a-f97a-4658-84a5-abf6cf1cbbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:47.971706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 120/236] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:48.173250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8841c0-d71a-45a7-999c-2229ef714913 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:48.173584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8841c0-d71a-45a7-999c-2229ef714913 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:48.173770 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8841c0-d71a-45a7-999c-2229ef714913 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:48.175409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 117/237] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:48.180274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634b7a5-d447-40fa-95a4-7ecfafdb87ee None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:48.180567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634b7a5-d447-40fa-95a4-7ecfafdb87ee None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:48.180850 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634b7a5-d447-40fa-95a4-7ecfafdb87ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:48.204186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c634b7a5-d447-40fa-95a4-7ecfafdb87ee None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:48.205396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c634b7a5-d447-40fa-95a4-7ecfafdb87ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:48.248951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8841c0-d71a-45a7-999c-2229ef714913 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:48.272490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:48.327407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 121/238] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:48.363481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8841c0-d71a-45a7-999c-2229ef714913 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:48.397692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441172bb-de31-441c-8ce7-8591add0413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:48.398356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441172bb-de31-441c-8ce7-8591add0413e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:48.398638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441172bb-de31-441c-8ce7-8591add0413e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:48.398915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441172bb-de31-441c-8ce7-8591add0413e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:48.409890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441172bb-de31-441c-8ce7-8591add0413e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-441172bb-de31-441c-8ce7-8591add0413e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:48.415010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:48.416002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:48.416787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:48.421174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 118/239] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:42:48.422596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634b7a5-d447-40fa-95a4-7ecfafdb87ee None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:48.523299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634b7a5-d447-40fa-95a4-7ecfafdb87ee None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:48.565360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e55dc-d5ef-46c4-bca5-ec5aeb0e4d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:48.565978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e55dc-d5ef-46c4-bca5-ec5aeb0e4d62 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:48.566297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e55dc-d5ef-46c4-bca5-ec5aeb0e4d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:48.566744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e55dc-d5ef-46c4-bca5-ec5aeb0e4d62 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:48.567530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e55dc-d5ef-46c4-bca5-ec5aeb0e4d62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:48.567939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e55dc-d5ef-46c4-bca5-ec5aeb0e4d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:48.569427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e55dc-d5ef-46c4-bca5-ec5aeb0e4d62 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:48.579007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 122/240] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:48.588853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441172bb-de31-441c-8ce7-8591add0413e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:48.665718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468fe81-f4ad-426e-8375-3069c6046ba9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:48.666024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468fe81-f4ad-426e-8375-3069c6046ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:48.666306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468fe81-f4ad-426e-8375-3069c6046ba9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:48.668503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 123/241] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:48.673485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77641496-c746-4385-998c-91be8e4dd899 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:48.673771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77641496-c746-4385-998c-91be8e4dd899 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:48.674050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77641496-c746-4385-998c-91be8e4dd899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:48.679236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:48.706266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-77641496-c746-4385-998c-91be8e4dd899 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:48.707460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-77641496-c746-4385-998c-91be8e4dd899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:48.722154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441172bb-de31-441c-8ce7-8591add0413e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:48.760304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:48.770523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08525dcd-e367-4151-a7b7-a3ea85a3fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:48.771168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08525dcd-e367-4151-a7b7-a3ea85a3fd5d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:48.771804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08525dcd-e367-4151-a7b7-a3ea85a3fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:48.772082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08525dcd-e367-4151-a7b7-a3ea85a3fd5d None admin] PATH_INFO: `/v3/users/ec151b37dca64bafa3a820eca0893d6c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:48.790864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08525dcd-e367-4151-a7b7-a3ea85a3fd5d None admin] RBAC: Authorizing `identity:get_user(user_id=ec151b37dca64bafa3a820eca0893d6c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:48.792273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08525dcd-e367-4151-a7b7-a3ea85a3fd5d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:48.798683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 119/242] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:48 2022] GET /identity/v3/users/ec151b37dca64bafa3a820eca0893d6c => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:48.798683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08525dcd-e367-4151-a7b7-a3ea85a3fd5d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:48.805888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 124/243] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:48.806624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77641496-c746-4385-998c-91be8e4dd899 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:48.941236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77641496-c746-4385-998c-91be8e4dd899 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:48.980549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be678-b9f2-4444-9777-20964a284bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:48.981461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be678-b9f2-4444-9777-20964a284bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:48.981747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be678-b9f2-4444-9777-20964a284bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:48.982022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be678-b9f2-4444-9777-20964a284bd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.044437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08525dcd-e367-4151-a7b7-a3ea85a3fd5d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:49.064413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:49.075734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:49.102656 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98be678-b9f2-4444-9777-20964a284bd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:49.103825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dad5d-a1cf-4790-ac0c-5097e2d0912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:49.104244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98be678-b9f2-4444-9777-20964a284bd4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:49.104460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dad5d-a1cf-4790-ac0c-5097e2d0912e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.104742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dad5d-a1cf-4790-ac0c-5097e2d0912e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.105044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dad5d-a1cf-4790-ac0c-5097e2d0912e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.106692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dad5d-a1cf-4790-ac0c-5097e2d0912e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:49.109033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dad5d-a1cf-4790-ac0c-5097e2d0912e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:49.110710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 120/244] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:49.111573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dad5d-a1cf-4790-ac0c-5097e2d0912e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:49.222923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 125/245] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:49.224058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be678-b9f2-4444-9777-20964a284bd4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:49.252135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dad5d-a1cf-4790-ac0c-5097e2d0912e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:49.296228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca5c10-28d1-48ad-833d-0c3f5885e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:49.297379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca5c10-28d1-48ad-833d-0c3f5885e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.297659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca5c10-28d1-48ad-833d-0c3f5885e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.297934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca5c10-28d1-48ad-833d-0c3f5885e2c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.301582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:49.313761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca5c10-28d1-48ad-833d-0c3f5885e2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4bca5c10-28d1-48ad-833d-0c3f5885e2c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:49.319302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:49.320196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:49.321010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:49.323774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 121/246] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:49.325269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca5c10-28d1-48ad-833d-0c3f5885e2c0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:49.341888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be678-b9f2-4444-9777-20964a284bd4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:49.378278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:49.379640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75647-2343-43b9-916d-f77ef6cc628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:49.380260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75647-2343-43b9-916d-f77ef6cc628d None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.380552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75647-2343-43b9-916d-f77ef6cc628d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.380828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75647-2343-43b9-916d-f77ef6cc628d None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.381493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c75647-2343-43b9-916d-f77ef6cc628d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:49.383035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c75647-2343-43b9-916d-f77ef6cc628d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:49.435369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca5c10-28d1-48ad-833d-0c3f5885e2c0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:49.467756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a6538-0867-49bc-83f8-d4965a470183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:49.468386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a6538-0867-49bc-83f8-d4965a470183 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.468699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a6538-0867-49bc-83f8-d4965a470183 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.468973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a6538-0867-49bc-83f8-d4965a470183 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.470105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a6538-0867-49bc-83f8-d4965a470183 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:49.471555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a6538-0867-49bc-83f8-d4965a470183 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:49.473179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 122/247] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:49 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:49.480825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa70e-72bf-4457-aeb8-7e1d63245df8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.480825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa70e-72bf-4457-aeb8-7e1d63245df8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.480825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa70e-72bf-4457-aeb8-7e1d63245df8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.480825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 123/248] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:49.480825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa70e-72bf-4457-aeb8-7e1d63245df8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:49.494449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 126/249] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:42:49 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:49.495188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75647-2343-43b9-916d-f77ef6cc628d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:49.627457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa70e-72bf-4457-aeb8-7e1d63245df8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:49.643886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75647-2343-43b9-916d-f77ef6cc628d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:49.648838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:49.677255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:49.679796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ccdcc-16c0-4d09-8801-e43faa3aa052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:49.680615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ccdcc-16c0-4d09-8801-e43faa3aa052 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.681099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ccdcc-16c0-4d09-8801-e43faa3aa052 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.681707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ccdcc-16c0-4d09-8801-e43faa3aa052 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.683824 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ccdcc-16c0-4d09-8801-e43faa3aa052 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:49.684315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ccdcc-16c0-4d09-8801-e43faa3aa052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:49.685867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ccdcc-16c0-4d09-8801-e43faa3aa052 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:49.686649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43f69b-5e09-4d77-be41-6f4436e02d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:49.687380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43f69b-5e09-4d77-be41-6f4436e02d9e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.687758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43f69b-5e09-4d77-be41-6f4436e02d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.688199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43f69b-5e09-4d77-be41-6f4436e02d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.689132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43f69b-5e09-4d77-be41-6f4436e02d9e None admin] RBAC: Adding query filter params (role.id=d9df243cfd5148769d90f26f275d55d6, scope.project.id=2128b23359fb4df3954335bb9c1edc4e, user.id=ec151b37dca64bafa3a820eca0893d6c) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:49.689454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43f69b-5e09-4d77-be41-6f4436e02d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:49.691698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43f69b-5e09-4d77-be41-6f4436e02d9e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:49.696255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 124/250] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:49.697336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca67cf-4e83-41c3-a1dd-73a459c85a9c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.697627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca67cf-4e83-41c3-a1dd-73a459c85a9c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.697906 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca67cf-4e83-41c3-a1dd-73a459c85a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.702753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 127/251] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:49 2022] GET /identity/v3/role_assignments?user.id=ec151b37dca64bafa3a820eca0893d6c&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=d9df243cfd5148769d90f26f275d55d6 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:49.703737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43f69b-5e09-4d77-be41-6f4436e02d9e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:49.721110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4fca67cf-4e83-41c3-a1dd-73a459c85a9c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:49.723909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4fca67cf-4e83-41c3-a1dd-73a459c85a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:49.812379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 125/252] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:49.845811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a825b2-0359-4fca-9c63-576e0fe1701a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.846175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a825b2-0359-4fca-9c63-576e0fe1701a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.846399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a825b2-0359-4fca-9c63-576e0fe1701a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.847921 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 126/253] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:49.853355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeda66-7bfd-4459-bc29-18a2f1c278a7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.853635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeda66-7bfd-4459-bc29-18a2f1c278a7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.853912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeda66-7bfd-4459-bc29-18a2f1c278a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.875466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0cfeda66-7bfd-4459-bc29-18a2f1c278a7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:49.876877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0cfeda66-7bfd-4459-bc29-18a2f1c278a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:49.881988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43f69b-5e09-4d77-be41-6f4436e02d9e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:49.924316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37f69-8f8f-4994-ab69-558f1e3f8483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:49.924962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37f69-8f8f-4994-ab69-558f1e3f8483 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:49.925252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37f69-8f8f-4994-ab69-558f1e3f8483 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:49.925533 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37f69-8f8f-4994-ab69-558f1e3f8483 None admin] PATH_INFO: `/v3/users/e691bb1d10224a65b56b0b7b8614d749` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:49.927816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37f69-8f8f-4994-ab69-558f1e3f8483 None admin] RBAC: Authorizing `identity:get_user(user_id=e691bb1d10224a65b56b0b7b8614d749)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:49.929370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb37f69-8f8f-4994-ab69-558f1e3f8483 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:49.935362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 128/254] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:49 2022] GET /identity/v3/users/e691bb1d10224a65b56b0b7b8614d749 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:49.941138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37f69-8f8f-4994-ab69-558f1e3f8483 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:49.975321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 127/255] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:50.015908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:50.059078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37f69-8f8f-4994-ab69-558f1e3f8483 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:50.093811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e522c4-567f-4fb2-b44d-3b27a2e5d9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:50.094485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e522c4-567f-4fb2-b44d-3b27a2e5d9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:50.094771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e522c4-567f-4fb2-b44d-3b27a2e5d9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:50.095056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e522c4-567f-4fb2-b44d-3b27a2e5d9c8 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:50.096211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e522c4-567f-4fb2-b44d-3b27a2e5d9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:50.097769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e522c4-567f-4fb2-b44d-3b27a2e5d9c8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:50.099737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 129/256] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:49 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:50.106052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeda66-7bfd-4459-bc29-18a2f1c278a7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:50.128626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e522c4-567f-4fb2-b44d-3b27a2e5d9c8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:50.153627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:50.235583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e522c4-567f-4fb2-b44d-3b27a2e5d9c8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:50.263158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:50.271077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5694-05c6-4e58-a38d-254a2e0c1cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:50.271950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5694-05c6-4e58-a38d-254a2e0c1cab None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:50.272428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5694-05c6-4e58-a38d-254a2e0c1cab None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:50.272865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5694-05c6-4e58-a38d-254a2e0c1cab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:50.277907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeda66-7bfd-4459-bc29-18a2f1c278a7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:50.284285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b5694-05c6-4e58-a38d-254a2e0c1cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c40b5694-05c6-4e58-a38d-254a2e0c1cab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:50.289375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:50.290279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:42:50.291061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:50.293640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 130/257] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:42:50.302518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5694-05c6-4e58-a38d-254a2e0c1cab None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:50.353269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57381-6133-431a-b767-cb8428b53d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:50.353933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57381-6133-431a-b767-cb8428b53d53 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:50.354342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57381-6133-431a-b767-cb8428b53d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:50.354724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb57381-6133-431a-b767-cb8428b53d53 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e/users/e691bb1d10224a65b56b0b7b8614d749/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:50.361931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb57381-6133-431a-b767-cb8428b53d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=2128b23359fb4df3954335bb9c1edc4e, user_id=e691bb1d10224a65b56b0b7b8614d749, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:50.363665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb57381-6133-431a-b767-cb8428b53d53 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:50.425715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5694-05c6-4e58-a38d-254a2e0c1cab None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:50.457235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 128/258] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:42:50 2022] PUT /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e/users/e691bb1d10224a65b56b0b7b8614d749/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:50.458136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57381-6133-431a-b767-cb8428b53d53 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:50.476348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbaf69-8d74-426f-87c9-bcd72405cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:50.476994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbaf69-8d74-426f-87c9-bcd72405cfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:50.477282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbaf69-8d74-426f-87c9-bcd72405cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:50.477561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbaf69-8d74-426f-87c9-bcd72405cfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:50.478283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbaf69-8d74-426f-87c9-bcd72405cfe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:50.478627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbaf69-8d74-426f-87c9-bcd72405cfe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:50.480198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbaf69-8d74-426f-87c9-bcd72405cfe2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:50.490870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 131/259] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:50.496534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbaf69-8d74-426f-87c9-bcd72405cfe2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:50.557409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:50.616736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbaf69-8d74-426f-87c9-bcd72405cfe2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:50.657919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4dc48-c026-4a35-8faf-f9f77b52ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:50.658774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4dc48-c026-4a35-8faf-f9f77b52ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:50.659158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4dc48-c026-4a35-8faf-f9f77b52ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:50.659948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4dc48-c026-4a35-8faf-f9f77b52ebd7 None admin] PATH_INFO: `/v3/users/e1b2f888cd054ee9b9300e0f6df3679e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:50.661402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4dc48-c026-4a35-8faf-f9f77b52ebd7 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b2f888cd054ee9b9300e0f6df3679e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:50.663038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4dc48-c026-4a35-8faf-f9f77b52ebd7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:50.665346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 132/260] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:50 2022] GET /identity/v3/users/e1b2f888cd054ee9b9300e0f6df3679e => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:50.671489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4dc48-c026-4a35-8faf-f9f77b52ebd7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:50.702222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:50.734330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb57381-6133-431a-b767-cb8428b53d53 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:50.804391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c81f0-37b9-4be0-9d4b-08ee9308a580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:50.805244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c81f0-37b9-4be0-9d4b-08ee9308a580 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:50.805551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c81f0-37b9-4be0-9d4b-08ee9308a580 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:50.805819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c81f0-37b9-4be0-9d4b-08ee9308a580 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:50.819471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c81f0-37b9-4be0-9d4b-08ee9308a580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2e0c81f0-37b9-4be0-9d4b-08ee9308a580 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:50.825209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:50.827233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:50.828543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 129/261] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:42:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:50.833066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c81f0-37b9-4be0-9d4b-08ee9308a580 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:50.891948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4dc48-c026-4a35-8faf-f9f77b52ebd7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:50.931293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:50.986801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c81f0-37b9-4be0-9d4b-08ee9308a580 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:51.005288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a681e-d247-4ce8-8995-b54aedd85f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:51.006439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a681e-d247-4ce8-8995-b54aedd85f7a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:51.006439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a681e-d247-4ce8-8995-b54aedd85f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:51.008035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a681e-d247-4ce8-8995-b54aedd85f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:51.051012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df210f-6291-4e1d-8fc8-6292ee1cd3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:51.051898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df210f-6291-4e1d-8fc8-6292ee1cd3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:51.052188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df210f-6291-4e1d-8fc8-6292ee1cd3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:51.052918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df210f-6291-4e1d-8fc8-6292ee1cd3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:51.053631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df210f-6291-4e1d-8fc8-6292ee1cd3f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:51.053942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df210f-6291-4e1d-8fc8-6292ee1cd3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:51.059848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df210f-6291-4e1d-8fc8-6292ee1cd3f2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:51.071878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 130/262] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:42:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:51.077806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df210f-6291-4e1d-8fc8-6292ee1cd3f2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:51.103013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:51.187454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a681e-d247-4ce8-8995-b54aedd85f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:51.189262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a681e-d247-4ce8-8995-b54aedd85f7a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:51.287259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df210f-6291-4e1d-8fc8-6292ee1cd3f2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:51.336854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 133/263] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:51.343257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a681e-d247-4ce8-8995-b54aedd85f7a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:51.360153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf8276-ec01-4afc-bd9f-d838a3c215b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:51.360710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf8276-ec01-4afc-bd9f-d838a3c215b1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:51.360989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf8276-ec01-4afc-bd9f-d838a3c215b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:51.361258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf8276-ec01-4afc-bd9f-d838a3c215b1 None admin] PATH_INFO: `/v3/users/e1b2f888cd054ee9b9300e0f6df3679e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:51.363247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf8276-ec01-4afc-bd9f-d838a3c215b1 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b2f888cd054ee9b9300e0f6df3679e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:51.364739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:51.364848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf8276-ec01-4afc-bd9f-d838a3c215b1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:51.366375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 131/264] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:51 2022] GET /identity/v3/users/e1b2f888cd054ee9b9300e0f6df3679e => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:51.372551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf8276-ec01-4afc-bd9f-d838a3c215b1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:51.452620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a681e-d247-4ce8-8995-b54aedd85f7a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:51.513592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab9b2-409e-45d1-a5cf-07d502a42a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:51.514343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab9b2-409e-45d1-a5cf-07d502a42a4a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:51.514625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab9b2-409e-45d1-a5cf-07d502a42a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:51.514894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acab9b2-409e-45d1-a5cf-07d502a42a4a None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:51.516045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acab9b2-409e-45d1-a5cf-07d502a42a4a None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:51.517492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acab9b2-409e-45d1-a5cf-07d502a42a4a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:51.520656 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 134/265] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:51 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:51.535324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab9b2-409e-45d1-a5cf-07d502a42a4a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:51.571810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:51.602294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf8276-ec01-4afc-bd9f-d838a3c215b1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:51.659907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d39259-73ed-4ab3-8d9d-9734c2c878cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:51.660533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d39259-73ed-4ab3-8d9d-9734c2c878cb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:51.660821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d39259-73ed-4ab3-8d9d-9734c2c878cb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:51.661102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d39259-73ed-4ab3-8d9d-9734c2c878cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:51.747595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:51.766499 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acab9b2-409e-45d1-a5cf-07d502a42a4a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:51.793328 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d39259-73ed-4ab3-8d9d-9734c2c878cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:51.795478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d39259-73ed-4ab3-8d9d-9734c2c878cb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:51.824081 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407b2b8-c884-41ab-9312-a8a2d5754e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:51.825015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407b2b8-c884-41ab-9312-a8a2d5754e89 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:51.825473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407b2b8-c884-41ab-9312-a8a2d5754e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:51.825919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407b2b8-c884-41ab-9312-a8a2d5754e89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:51.826907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407b2b8-c884-41ab-9312-a8a2d5754e89 None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=2128b23359fb4df3954335bb9c1edc4e, user.id=e1b2f888cd054ee9b9300e0f6df3679e) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:51.827443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407b2b8-c884-41ab-9312-a8a2d5754e89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:51.829064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407b2b8-c884-41ab-9312-a8a2d5754e89 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:51.841312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 135/266] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:51 2022] GET /identity/v3/role_assignments?user.id=e1b2f888cd054ee9b9300e0f6df3679e&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:51.919436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:51.946304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 132/267] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:42:51.952694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407b2b8-c884-41ab-9312-a8a2d5754e89 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:52.110390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407b2b8-c884-41ab-9312-a8a2d5754e89 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:52.162530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b95524-f81d-4c22-9c5d-05dc33646e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:52.163605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b95524-f81d-4c22-9c5d-05dc33646e62 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:52.164085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b95524-f81d-4c22-9c5d-05dc33646e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:52.164566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b95524-f81d-4c22-9c5d-05dc33646e62 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:52.167813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b95524-f81d-4c22-9c5d-05dc33646e62 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:52.169695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b95524-f81d-4c22-9c5d-05dc33646e62 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:52.172046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 136/268] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:51 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:52.178205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d39259-73ed-4ab3-8d9d-9734c2c878cb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:52.313830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d39259-73ed-4ab3-8d9d-9734c2c878cb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:52.355845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15dfc9-1acd-45fa-8021-ef791b801e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:52.356725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15dfc9-1acd-45fa-8021-ef791b801e4b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:52.357012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15dfc9-1acd-45fa-8021-ef791b801e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:52.357347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15dfc9-1acd-45fa-8021-ef791b801e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:52.358106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15dfc9-1acd-45fa-8021-ef791b801e4b None admin] RBAC: Adding query filter params (role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=2128b23359fb4df3954335bb9c1edc4e, user.id=e1b2f888cd054ee9b9300e0f6df3679e) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:52.358459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15dfc9-1acd-45fa-8021-ef791b801e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:52.359925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15dfc9-1acd-45fa-8021-ef791b801e4b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:52.371120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 133/269] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:52 2022] GET /identity/v3/role_assignments?user.id=e1b2f888cd054ee9b9300e0f6df3679e&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:52.630992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166fb4-794b-4269-8c28-ff95021aec53 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:52.632051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166fb4-794b-4269-8c28-ff95021aec53 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:52.632542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67166fb4-794b-4269-8c28-ff95021aec53 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:52.634675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 137/270] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:52.648097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b614-5e70-47b1-a90e-5b7bf5743f33 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:52.648382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b614-5e70-47b1-a90e-5b7bf5743f33 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:52.648826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b614-5e70-47b1-a90e-5b7bf5743f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:52.670490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3960b614-5e70-47b1-a90e-5b7bf5743f33 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:52.672132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3960b614-5e70-47b1-a90e-5b7bf5743f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:52.718823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:52.747553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 134/271] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:52.754278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90385906-b12f-4969-88b1-84576a90db3f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:52.754568 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90385906-b12f-4969-88b1-84576a90db3f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:52.754848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90385906-b12f-4969-88b1-84576a90db3f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:52.756220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 138/272] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:52.762405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc233a-711d-439f-988b-1a8e423ffac3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:52.762703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc233a-711d-439f-988b-1a8e423ffac3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:52.762986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc233a-711d-439f-988b-1a8e423ffac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:52.783315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a1cc233a-711d-439f-988b-1a8e423ffac3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:52.784541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a1cc233a-711d-439f-988b-1a8e423ffac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:52.858547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 135/273] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:53.051102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90385906-b12f-4969-88b1-84576a90db3f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.076379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:53.119938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6103b1-1cb4-45b5-9531-7927e1a97116 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.120225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6103b1-1cb4-45b5-9531-7927e1a97116 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.120538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6103b1-1cb4-45b5-9531-7927e1a97116 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.121885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 136/274] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:53.127229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abddae-0140-4f0f-84ef-6d3e7bf6d2ff None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.127726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abddae-0140-4f0f-84ef-6d3e7bf6d2ff None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.128547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abddae-0140-4f0f-84ef-6d3e7bf6d2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.148893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-64abddae-0140-4f0f-84ef-6d3e7bf6d2ff None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:53.150115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-64abddae-0140-4f0f-84ef-6d3e7bf6d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:53.174801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90385906-b12f-4969-88b1-84576a90db3f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.211747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd51629-d87c-4f03-8d9f-85b9b9a7fde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.212301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd51629-d87c-4f03-8d9f-85b9b9a7fde6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.212581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd51629-d87c-4f03-8d9f-85b9b9a7fde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.212929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd51629-d87c-4f03-8d9f-85b9b9a7fde6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.220587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 137/275] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:53.221270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abddae-0140-4f0f-84ef-6d3e7bf6d2ff None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.233649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd51629-d87c-4f03-8d9f-85b9b9a7fde6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fbd51629-d87c-4f03-8d9f-85b9b9a7fde6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:53.238538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:53.239406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:53.240221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 139/276] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:53.245809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd51629-d87c-4f03-8d9f-85b9b9a7fde6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.265066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:53.342620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:53.349296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abddae-0140-4f0f-84ef-6d3e7bf6d2ff None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.355619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd51629-d87c-4f03-8d9f-85b9b9a7fde6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.392093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f444d-9c88-4522-94a0-4652673059db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.392801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f444d-9c88-4522-94a0-4652673059db None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.393036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f444d-9c88-4522-94a0-4652673059db None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.393318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f444d-9c88-4522-94a0-4652673059db None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.394120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f444d-9c88-4522-94a0-4652673059db None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:53.394431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f444d-9c88-4522-94a0-4652673059db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:53.395863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f444d-9c88-4522-94a0-4652673059db None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:53.398073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a7a88-1e77-4382-83ee-068bbe4839a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.399269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7a88-1e77-4382-83ee-068bbe4839a1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.399735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7a88-1e77-4382-83ee-068bbe4839a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.400188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7a88-1e77-4382-83ee-068bbe4839a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.405822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 140/277] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:53.411203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f444d-9c88-4522-94a0-4652673059db None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.413974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a7a88-1e77-4382-83ee-068bbe4839a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-436a7a88-1e77-4382-83ee-068bbe4839a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:53.421030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:53.421911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:53.422748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:53.424935 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 138/278] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:53.430610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a7a88-1e77-4382-83ee-068bbe4839a1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.536844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:53.540455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f444d-9c88-4522-94a0-4652673059db None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.543243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a7a88-1e77-4382-83ee-068bbe4839a1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.581405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabea72-4d96-4b10-bd7c-543537a94573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.581630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c7aa1-0b3f-4de4-90f9-558a3a5dba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.582051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c7aa1-0b3f-4de4-90f9-558a3a5dba12 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.582192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabea72-4d96-4b10-bd7c-543537a94573 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.582371 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c7aa1-0b3f-4de4-90f9-558a3a5dba12 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.582484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabea72-4d96-4b10-bd7c-543537a94573 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.582650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c7aa1-0b3f-4de4-90f9-558a3a5dba12 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.582756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabea72-4d96-4b10-bd7c-543537a94573 None admin] PATH_INFO: `/v3/users/fdcd7b19e93a449698f69daaf6e29038` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.583350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c7aa1-0b3f-4de4-90f9-558a3a5dba12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:53.583660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c7aa1-0b3f-4de4-90f9-558a3a5dba12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:53.585112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c7aa1-0b3f-4de4-90f9-558a3a5dba12 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:53.595583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:53.598660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 139/279] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:53.599259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabea72-4d96-4b10-bd7c-543537a94573 None admin] RBAC: Authorizing `identity:get_user(user_id=fdcd7b19e93a449698f69daaf6e29038)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:53.599438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c7aa1-0b3f-4de4-90f9-558a3a5dba12 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.600737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabea72-4d96-4b10-bd7c-543537a94573 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:53.602658 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 141/280] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/users/fdcd7b19e93a449698f69daaf6e29038 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:53.603465 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabea72-4d96-4b10-bd7c-543537a94573 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.706349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c7aa1-0b3f-4de4-90f9-558a3a5dba12 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.718311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabea72-4d96-4b10-bd7c-543537a94573 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.739686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615288a4-db89-410c-b425-f72dbc0737cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.740312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615288a4-db89-410c-b425-f72dbc0737cf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.740594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615288a4-db89-410c-b425-f72dbc0737cf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.740876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615288a4-db89-410c-b425-f72dbc0737cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.741983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615288a4-db89-410c-b425-f72dbc0737cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:53.743469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615288a4-db89-410c-b425-f72dbc0737cf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:53.745037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 140/281] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:53.745869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615288a4-db89-410c-b425-f72dbc0737cf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.753307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc246d60-c24b-4b08-b4bd-2eb93d753fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.753995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246d60-c24b-4b08-b4bd-2eb93d753fcf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.754308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246d60-c24b-4b08-b4bd-2eb93d753fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.754605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc246d60-c24b-4b08-b4bd-2eb93d753fcf None admin] PATH_INFO: `/v3/users/ec151b37dca64bafa3a820eca0893d6c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.755732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246d60-c24b-4b08-b4bd-2eb93d753fcf None admin] RBAC: Authorizing `identity:get_user(user_id=ec151b37dca64bafa3a820eca0893d6c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:53.759116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc246d60-c24b-4b08-b4bd-2eb93d753fcf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:53.759116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 142/282] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/users/ec151b37dca64bafa3a820eca0893d6c => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:53.759864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4233ef6-0962-417e-b8f4-b410f51315d2 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.760143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4233ef6-0962-417e-b8f4-b410f51315d2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.760416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4233ef6-0962-417e-b8f4-b410f51315d2 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.761790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 143/283] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:53.762343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4233ef6-0962-417e-b8f4-b410f51315d2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.781926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:53.828505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:53.852807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615288a4-db89-410c-b425-f72dbc0737cf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.863998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4233ef6-0962-417e-b8f4-b410f51315d2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:53.886129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b23491-9e08-4ffa-bad0-8407186822a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.886733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b23491-9e08-4ffa-bad0-8407186822a8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.887012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b23491-9e08-4ffa-bad0-8407186822a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.887278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b23491-9e08-4ffa-bad0-8407186822a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.887994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b23491-9e08-4ffa-bad0-8407186822a8 None admin] RBAC: Adding query filter params (role.id=522cad34ce354f77b50e5490fdb6174d, user.id=fdcd7b19e93a449698f69daaf6e29038, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:53.888296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b23491-9e08-4ffa-bad0-8407186822a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:53.889719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b23491-9e08-4ffa-bad0-8407186822a8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:53.894731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 141/284] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/role_assignments?user.id=fdcd7b19e93a449698f69daaf6e29038&scope.system=all&role.id=522cad34ce354f77b50e5490fdb6174d => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:53.895521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b23491-9e08-4ffa-bad0-8407186822a8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:53.901410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b91cb5-a861-4b4a-b232-7b2a307dfc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:53.902560 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b91cb5-a861-4b4a-b232-7b2a307dfc7e None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:53.902835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b91cb5-a861-4b4a-b232-7b2a307dfc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:53.903105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b91cb5-a861-4b4a-b232-7b2a307dfc7e None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:53.904052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b91cb5-a861-4b4a-b232-7b2a307dfc7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:53.906582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b91cb5-a861-4b4a-b232-7b2a307dfc7e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:54.002306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:54.011336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 144/285] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:42:53 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:54.012826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f542c6b-e565-4756-99f9-aaed03156e38 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:54.012990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b23491-9e08-4ffa-bad0-8407186822a8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:54.013116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f542c6b-e565-4756-99f9-aaed03156e38 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:54.013639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f542c6b-e565-4756-99f9-aaed03156e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:54.043246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4f542c6b-e565-4756-99f9-aaed03156e38 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:54.044579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4f542c6b-e565-4756-99f9-aaed03156e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:54.057896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313f3de-d0e5-4bb9-b5d4-e1057edcd922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:54.058821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313f3de-d0e5-4bb9-b5d4-e1057edcd922 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:54.059176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313f3de-d0e5-4bb9-b5d4-e1057edcd922 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:54.059570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313f3de-d0e5-4bb9-b5d4-e1057edcd922 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:54.061029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313f3de-d0e5-4bb9-b5d4-e1057edcd922 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:54.062929 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313f3de-d0e5-4bb9-b5d4-e1057edcd922 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:54.066298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 142/286] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:53 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:54.075856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313f3de-d0e5-4bb9-b5d4-e1057edcd922 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:54.137728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 145/287] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:54.193370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313f3de-d0e5-4bb9-b5d4-e1057edcd922 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:54.229608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50643dd-9e07-4595-99b6-ab3e54d9b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:54.230731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50643dd-9e07-4595-99b6-ab3e54d9b678 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:54.231440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50643dd-9e07-4595-99b6-ab3e54d9b678 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:54.231884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50643dd-9e07-4595-99b6-ab3e54d9b678 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e/users/ec151b37dca64bafa3a820eca0893d6c/roles/d9df243cfd5148769d90f26f275d55d6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:54.233987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50643dd-9e07-4595-99b6-ab3e54d9b678 None admin] RBAC: Authorizing `identity:create_grant(project_id=2128b23359fb4df3954335bb9c1edc4e, user_id=ec151b37dca64bafa3a820eca0893d6c, role_id=d9df243cfd5148769d90f26f275d55d6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:54.235647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50643dd-9e07-4595-99b6-ab3e54d9b678 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:54.344272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 143/288] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:42:54 2022] PUT /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e/users/ec151b37dca64bafa3a820eca0893d6c/roles/d9df243cfd5148769d90f26f275d55d6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:54.417680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f542c6b-e565-4756-99f9-aaed03156e38 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:54.484284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:54.538975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f542c6b-e565-4756-99f9-aaed03156e38 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:54.575980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5b40d-a572-42b5-ab15-13a37be0da2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:54.576667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5b40d-a572-42b5-ab15-13a37be0da2b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:54.576950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5b40d-a572-42b5-ab15-13a37be0da2b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:54.577221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5b40d-a572-42b5-ab15-13a37be0da2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:54.587615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5b40d-a572-42b5-ab15-13a37be0da2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9eb5b40d-a572-42b5-ab15-13a37be0da2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:54.593032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:54.593930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:54.594736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 146/289] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:54.601697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50643dd-9e07-4595-99b6-ab3e54d9b678 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:54.624684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:54.722098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50643dd-9e07-4595-99b6-ab3e54d9b678 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:54.760252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaecb0-26c9-43a3-ab20-d12be078454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:54.760933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaecb0-26c9-43a3-ab20-d12be078454a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:54.761877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaecb0-26c9-43a3-ab20-d12be078454a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:54.762182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaecb0-26c9-43a3-ab20-d12be078454a None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:54.762904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaecb0-26c9-43a3-ab20-d12be078454a None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:54.763210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaecb0-26c9-43a3-ab20-d12be078454a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:54.764590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaecb0-26c9-43a3-ab20-d12be078454a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:54.773398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 144/290] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:54.778899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5b40d-a572-42b5-ab15-13a37be0da2b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:54.896137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5b40d-a572-42b5-ab15-13a37be0da2b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:54.909384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:54.942107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da67514-4780-4854-9a80-17ea0f78498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:54.942107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da67514-4780-4854-9a80-17ea0f78498c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:54.942107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da67514-4780-4854-9a80-17ea0f78498c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:54.942107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da67514-4780-4854-9a80-17ea0f78498c None admin] PATH_INFO: `/v3/users/e691bb1d10224a65b56b0b7b8614d749` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:54.946804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da67514-4780-4854-9a80-17ea0f78498c None admin] RBAC: Authorizing `identity:get_user(user_id=e691bb1d10224a65b56b0b7b8614d749)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:54.948279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da67514-4780-4854-9a80-17ea0f78498c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:54.950180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 147/291] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:54 2022] GET /identity/v3/users/e691bb1d10224a65b56b0b7b8614d749 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:54.955644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaecb0-26c9-43a3-ab20-d12be078454a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:55.096101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:55.117889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaecb0-26c9-43a3-ab20-d12be078454a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:55.172700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacb5a2-27e8-40ba-9bec-d3ff34c33962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:55.173324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacb5a2-27e8-40ba-9bec-d3ff34c33962 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:55.173608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacb5a2-27e8-40ba-9bec-d3ff34c33962 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:55.173884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bacb5a2-27e8-40ba-9bec-d3ff34c33962 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:55.264154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacb5a2-27e8-40ba-9bec-d3ff34c33962 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:55.265653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bacb5a2-27e8-40ba-9bec-d3ff34c33962 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:55.375967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:55.399561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 145/292] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:55.405748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da67514-4780-4854-9a80-17ea0f78498c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:55.545820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da67514-4780-4854-9a80-17ea0f78498c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:55.579521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622f403-117e-444b-89e8-5dd6ca2bd28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:55.580149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622f403-117e-444b-89e8-5dd6ca2bd28f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:55.580432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622f403-117e-444b-89e8-5dd6ca2bd28f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:55.580707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622f403-117e-444b-89e8-5dd6ca2bd28f None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:55.581843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622f403-117e-444b-89e8-5dd6ca2bd28f None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:55.583321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622f403-117e-444b-89e8-5dd6ca2bd28f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:55.585249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 148/293] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:55 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:55.590898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacb5a2-27e8-40ba-9bec-d3ff34c33962 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:55.730888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bacb5a2-27e8-40ba-9bec-d3ff34c33962 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:55.766987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c4ecb-098b-4dfb-a212-76cb70926c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:55.767597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c4ecb-098b-4dfb-a212-76cb70926c74 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:55.767944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c4ecb-098b-4dfb-a212-76cb70926c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:55.768216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c4ecb-098b-4dfb-a212-76cb70926c74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:55.768995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c4ecb-098b-4dfb-a212-76cb70926c74 None admin] RBAC: Adding query filter params (role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=2128b23359fb4df3954335bb9c1edc4e, user.id=e691bb1d10224a65b56b0b7b8614d749) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:55.769304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c4ecb-098b-4dfb-a212-76cb70926c74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:55.770768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c4ecb-098b-4dfb-a212-76cb70926c74 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:55.777276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 146/294] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:55 2022] GET /identity/v3/role_assignments?user.id=e691bb1d10224a65b56b0b7b8614d749&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=522cad34ce354f77b50e5490fdb6174d => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:56.361155 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c34894-ee23-4f4f-82e8-fd4c5ac7ca6d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:56.361664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c34894-ee23-4f4f-82e8-fd4c5ac7ca6d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:56.361767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c34894-ee23-4f4f-82e8-fd4c5ac7ca6d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:56.363298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 149/295] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:56.369486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b23db7-fb12-4450-8b9e-1bcee17df01d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:56.370036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b23db7-fb12-4450-8b9e-1bcee17df01d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:56.371130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b23db7-fb12-4450-8b9e-1bcee17df01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:56.396408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-42b23db7-fb12-4450-8b9e-1bcee17df01d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:56.397953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-42b23db7-fb12-4450-8b9e-1bcee17df01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:56.452115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:56.490278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 147/296] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:56.765999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c34894-ee23-4f4f-82e8-fd4c5ac7ca6d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:56.818168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa19cb-1ad3-4656-ac7c-ac8d8bcb81ad None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:56.818705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa19cb-1ad3-4656-ac7c-ac8d8bcb81ad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:56.818705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa19cb-1ad3-4656-ac7c-ac8d8bcb81ad None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:56.820090 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 148/297] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:56.825639 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913adac-5686-47e7-931c-23ca42607929 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:56.825932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913adac-5686-47e7-931c-23ca42607929 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:56.826244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913adac-5686-47e7-931c-23ca42607929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:56.847240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9913adac-5686-47e7-931c-23ca42607929 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:56.848828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9913adac-5686-47e7-931c-23ca42607929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:56.861180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:56.924344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c34894-ee23-4f4f-82e8-fd4c5ac7ca6d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:56.925265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 149/298] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:42:56.935746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427901e-64f9-416f-830b-5aeaa801d517 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:56.936031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427901e-64f9-416f-830b-5aeaa801d517 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:56.936313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427901e-64f9-416f-830b-5aeaa801d517 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:56.939164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 150/299] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:56.943986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f23fc-7d11-45f2-91b4-8b503701a806 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:56.944288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f23fc-7d11-45f2-91b4-8b503701a806 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:56.944538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f23fc-7d11-45f2-91b4-8b503701a806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:56.964747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-947f23fc-7d11-45f2-91b4-8b503701a806 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:56.966122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-947f23fc-7d11-45f2-91b4-8b503701a806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:56.974617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cfd0d-a7ca-4eaa-8384-808a760aacaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:56.975566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cfd0d-a7ca-4eaa-8384-808a760aacaf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:56.976040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cfd0d-a7ca-4eaa-8384-808a760aacaf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:56.976533 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cfd0d-a7ca-4eaa-8384-808a760aacaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:56.989028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cfd0d-a7ca-4eaa-8384-808a760aacaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6e2cfd0d-a7ca-4eaa-8384-808a760aacaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:56.994426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:56.995922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:42:56.997282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:56.999697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 150/300] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:57.005786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cfd0d-a7ca-4eaa-8384-808a760aacaf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.047917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 151/301] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:57.053110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73355-7ca8-4538-955e-98c48dfeb15b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.053405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73355-7ca8-4538-955e-98c48dfeb15b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.053684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73355-7ca8-4538-955e-98c48dfeb15b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.062195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 152/302] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:42:57.062195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25106e06-8d16-4fdd-9ff4-8daeaa70c63c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.062195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25106e06-8d16-4fdd-9ff4-8daeaa70c63c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.062195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25106e06-8d16-4fdd-9ff4-8daeaa70c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.080578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-25106e06-8d16-4fdd-9ff4-8daeaa70c63c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:57.082756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-25106e06-8d16-4fdd-9ff4-8daeaa70c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:57.113661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cfd0d-a7ca-4eaa-8384-808a760aacaf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:57.115291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:57.132036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:57.149205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bef57-9e29-4403-8635-e302f06c11b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:57.150017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bef57-9e29-4403-8635-e302f06c11b3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.150336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bef57-9e29-4403-8635-e302f06c11b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.150613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bef57-9e29-4403-8635-e302f06c11b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.151348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bef57-9e29-4403-8635-e302f06c11b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:57.152240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bef57-9e29-4403-8635-e302f06c11b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:57.154232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bef57-9e29-4403-8635-e302f06c11b3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:57.170129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 151/303] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:57.170129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bef57-9e29-4403-8635-e302f06c11b3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.170726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 153/304] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:42:57.204391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25106e06-8d16-4fdd-9ff4-8daeaa70c63c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.285269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bef57-9e29-4403-8635-e302f06c11b3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:57.325095 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9f81c-6f89-457a-98da-4082a72ed66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:57.326246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9f81c-6f89-457a-98da-4082a72ed66d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.326530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9f81c-6f89-457a-98da-4082a72ed66d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.326822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9f81c-6f89-457a-98da-4082a72ed66d None admin] PATH_INFO: `/v3/users/fdcd7b19e93a449698f69daaf6e29038` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.327969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9f81c-6f89-457a-98da-4082a72ed66d None admin] RBAC: Authorizing `identity:get_user(user_id=fdcd7b19e93a449698f69daaf6e29038)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:57.329431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9f81c-6f89-457a-98da-4082a72ed66d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:57.335487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 152/305] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:57 2022] GET /identity/v3/users/fdcd7b19e93a449698f69daaf6e29038 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:57.337362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9f81c-6f89-457a-98da-4082a72ed66d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.342537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25106e06-8d16-4fdd-9ff4-8daeaa70c63c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:57.381448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:57.381960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7a00-120a-4db3-a197-e1555225ba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:57.382118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7a00-120a-4db3-a197-e1555225ba54 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.382412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7a00-120a-4db3-a197-e1555225ba54 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.382742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7a00-120a-4db3-a197-e1555225ba54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.383903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd7a00-120a-4db3-a197-e1555225ba54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:57.385357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd7a00-120a-4db3-a197-e1555225ba54 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:57.387468 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 154/306] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:42:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:57.388232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7a00-120a-4db3-a197-e1555225ba54 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.421308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:57.449888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9f81c-6f89-457a-98da-4082a72ed66d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:57.485514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33e8f-275c-487f-8217-0a46aa61c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:57.486188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33e8f-275c-487f-8217-0a46aa61c679 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.486472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33e8f-275c-487f-8217-0a46aa61c679 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.486747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33e8f-275c-487f-8217-0a46aa61c679 None admin] PATH_INFO: `/v3/system/users/fdcd7b19e93a449698f69daaf6e29038/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.488147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df33e8f-275c-487f-8217-0a46aa61c679 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fdcd7b19e93a449698f69daaf6e29038, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:57.489517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df33e8f-275c-487f-8217-0a46aa61c679 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:57.490175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7a00-120a-4db3-a197-e1555225ba54 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:57.523408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e263-833c-4ef0-9318-e5f19c6effe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:57.524032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e263-833c-4ef0-9318-e5f19c6effe5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.524314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e263-833c-4ef0-9318-e5f19c6effe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.524588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e263-833c-4ef0-9318-e5f19c6effe5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.534903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23e263-833c-4ef0-9318-e5f19c6effe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3f23e263-833c-4ef0-9318-e5f19c6effe5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:57.539739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:57.540783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 155/307] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:57.541704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e263-833c-4ef0-9318-e5f19c6effe5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.591461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 153/308] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Oct 4 08:42:57 2022] PUT /identity/v3/system/users/fdcd7b19e93a449698f69daaf6e29038/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:42:57.592425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33e8f-275c-487f-8217-0a46aa61c679 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.634012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:57.644373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e263-833c-4ef0-9318-e5f19c6effe5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:57.686294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3124bd8-ab80-4c10-a12a-0a84fbe8f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:57.686979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3124bd8-ab80-4c10-a12a-0a84fbe8f1a3 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.687215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3124bd8-ab80-4c10-a12a-0a84fbe8f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.687496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3124bd8-ab80-4c10-a12a-0a84fbe8f1a3 None admin] PATH_INFO: `/v3/groups` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.688174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3124bd8-ab80-4c10-a12a-0a84fbe8f1a3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:57.689681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3124bd8-ab80-4c10-a12a-0a84fbe8f1a3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:57.709763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33e8f-275c-487f-8217-0a46aa61c679 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:57.711482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:57.746500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2411c3-24c5-4180-b037-a16d64cdc0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:57.747154 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2411c3-24c5-4180-b037-a16d64cdc0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.747437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2411c3-24c5-4180-b037-a16d64cdc0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.747714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2411c3-24c5-4180-b037-a16d64cdc0c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.766115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 156/309] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Oct 4 08:42:57 2022] POST /identity/v3/groups => generated 229 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:42:57.766115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3124bd8-ab80-4c10-a12a-0a84fbe8f1a3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2411c3-24c5-4180-b037-a16d64cdc0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bc2411c3-24c5-4180-b037-a16d64cdc0c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:42:57.766406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:42:57.767603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:42:57.768630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 154/310] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:42:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:42:57.776090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2411c3-24c5-4180-b037-a16d64cdc0c9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.908902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2411c3-24c5-4180-b037-a16d64cdc0c9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:57.930120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3124bd8-ab80-4c10-a12a-0a84fbe8f1a3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:57.968187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049516db-1e57-4045-8946-9d18b04c6263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:57.968803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049516db-1e57-4045-8946-9d18b04c6263 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.969085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049516db-1e57-4045-8946-9d18b04c6263 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.969365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049516db-1e57-4045-8946-9d18b04c6263 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.970050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049516db-1e57-4045-8946-9d18b04c6263 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:57.970388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049516db-1e57-4045-8946-9d18b04c6263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:57.971898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049516db-1e57-4045-8946-9d18b04c6263 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:57.981816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb8851-b319-4035-a949-3c297e4a6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:57.982150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 155/311] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:57.982678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb8851-b319-4035-a949-3c297e4a6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:57.982960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb8851-b319-4035-a949-3c297e4a6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:57.983235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb8851-b319-4035-a949-3c297e4a6cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:57.983914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb8851-b319-4035-a949-3c297e4a6cb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:57.984218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb8851-b319-4035-a949-3c297e4a6cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:57.985608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb8851-b319-4035-a949-3c297e4a6cb6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:57.993909 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049516db-1e57-4045-8946-9d18b04c6263 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:57.994786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 157/312] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:42:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:58.000959 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb8851-b319-4035-a949-3c297e4a6cb6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:58.022544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:58.027489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:58.119204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049516db-1e57-4045-8946-9d18b04c6263 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:58.125701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb8851-b319-4035-a949-3c297e4a6cb6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:58.158679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b353858-e833-4afa-b438-07af91a818d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:58.159769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b353858-e833-4afa-b438-07af91a818d3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:58.160248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b353858-e833-4afa-b438-07af91a818d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:58.160718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b353858-e833-4afa-b438-07af91a818d3 None admin] PATH_INFO: `/v3/users/ec151b37dca64bafa3a820eca0893d6c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:58.162808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b353858-e833-4afa-b438-07af91a818d3 None admin] RBAC: Authorizing `identity:get_user(user_id=ec151b37dca64bafa3a820eca0893d6c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:58.165009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b353858-e833-4afa-b438-07af91a818d3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:58.166429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfc3f8-c129-43e4-8d7b-c554f0b6e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:58.167106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc3f8-c129-43e4-8d7b-c554f0b6e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:58.167392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc3f8-c129-43e4-8d7b-c554f0b6e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:58.167675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc3f8-c129-43e4-8d7b-c554f0b6e6c5 None admin] PATH_INFO: `/v3/users/a11660abcec448e8951f067084f56610` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:58.168311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 156/313] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:57 2022] GET /identity/v3/users/ec151b37dca64bafa3a820eca0893d6c => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:58.174383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b353858-e833-4afa-b438-07af91a818d3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:58.183045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfc3f8-c129-43e4-8d7b-c554f0b6e6c5 None admin] RBAC: Authorizing `identity:get_user(user_id=a11660abcec448e8951f067084f56610)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:58.184581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfc3f8-c129-43e4-8d7b-c554f0b6e6c5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:58.186913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 158/314] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:42:57 2022] GET /identity/v3/users/a11660abcec448e8951f067084f56610 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:58.192385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfc3f8-c129-43e4-8d7b-c554f0b6e6c5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:58.262557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:58.295932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:58.301188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfc3f8-c129-43e4-8d7b-c554f0b6e6c5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:58.306100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b353858-e833-4afa-b438-07af91a818d3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:58.346212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4e164-c5b5-45f6-90bb-36a00be59d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:58.347085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236bcb3-83e6-447e-829c-eb26dc82c1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:58.347261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4e164-c5b5-45f6-90bb-36a00be59d50 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:58.347675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4e164-c5b5-45f6-90bb-36a00be59d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:58.347862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236bcb3-83e6-447e-829c-eb26dc82c1cc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:58.348227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236bcb3-83e6-447e-829c-eb26dc82c1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:58.348363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4e164-c5b5-45f6-90bb-36a00be59d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:58.348617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236bcb3-83e6-447e-829c-eb26dc82c1cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:58.349371 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4e164-c5b5-45f6-90bb-36a00be59d50 None admin] RBAC: Adding query filter params (role.id=d9df243cfd5148769d90f26f275d55d6, user.id=a11660abcec448e8951f067084f56610, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:58.349822 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4e164-c5b5-45f6-90bb-36a00be59d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:58.351629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4e164-c5b5-45f6-90bb-36a00be59d50 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:58.365368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 159/315] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Oct 4 08:42:58 2022] GET /identity/v3/role_assignments?user.id=a11660abcec448e8951f067084f56610&scope.system=all&role.id=d9df243cfd5148769d90f26f275d55d6 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:42:58.430661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236bcb3-83e6-447e-829c-eb26dc82c1cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:58.432101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236bcb3-83e6-447e-829c-eb26dc82c1cc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:58.538476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:58.553991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 157/316] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:42:58.555083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4e164-c5b5-45f6-90bb-36a00be59d50 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:58.659465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4e164-c5b5-45f6-90bb-36a00be59d50 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:58.694041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698362-a34f-4aaa-8328-1689e61b44c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:58.694695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698362-a34f-4aaa-8328-1689e61b44c4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:58.694978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698362-a34f-4aaa-8328-1689e61b44c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:58.695251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698362-a34f-4aaa-8328-1689e61b44c4 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:58.696381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8698362-a34f-4aaa-8328-1689e61b44c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:58.697818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8698362-a34f-4aaa-8328-1689e61b44c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:58.699848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 160/317] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:42:58 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:58.705550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236bcb3-83e6-447e-829c-eb26dc82c1cc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:42:58.929250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236bcb3-83e6-447e-829c-eb26dc82c1cc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:42:58.965396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057a7e6-de01-42fc-a37d-ceac22ab82d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:42:58.965929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057a7e6-de01-42fc-a37d-ceac22ab82d4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:58.966242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057a7e6-de01-42fc-a37d-ceac22ab82d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:58.966517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057a7e6-de01-42fc-a37d-ceac22ab82d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:58.967306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057a7e6-de01-42fc-a37d-ceac22ab82d4 None admin] RBAC: Adding query filter params (role.id=d9df243cfd5148769d90f26f275d55d6, scope.project.id=2128b23359fb4df3954335bb9c1edc4e, user.id=ec151b37dca64bafa3a820eca0893d6c) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:42:58.967622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057a7e6-de01-42fc-a37d-ceac22ab82d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:42:58.969072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057a7e6-de01-42fc-a37d-ceac22ab82d4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:42:58.975099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 158/318] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:42:58 2022] GET /identity/v3/role_assignments?user.id=ec151b37dca64bafa3a820eca0893d6c&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=d9df243cfd5148769d90f26f275d55d6 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:42:59.802237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e97fa3-72e8-4754-915b-5db9100f1d97 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:59.802747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e97fa3-72e8-4754-915b-5db9100f1d97 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:59.802822 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e97fa3-72e8-4754-915b-5db9100f1d97 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:59.804280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 161/319] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:42:59.809932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c4c79-3eb0-4d4c-a64a-9070e9d758ac None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:42:59.810371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c4c79-3eb0-4d4c-a64a-9070e9d758ac None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:42:59.810579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c4c79-3eb0-4d4c-a64a-9070e9d758ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:42:59.830009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d63c4c79-3eb0-4d4c-a64a-9070e9d758ac None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:42:59.831230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d63c4c79-3eb0-4d4c-a64a-9070e9d758ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:42:59.879520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:42:59.896662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 159/320] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:00.010623 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e23f0c-7617-41b4-a25a-0b6ef756326a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.011521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e23f0c-7617-41b4-a25a-0b6ef756326a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.011736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e23f0c-7617-41b4-a25a-0b6ef756326a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.013225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 162/321] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:00.018239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459d849-16f4-45b1-a3dd-a5330e27c78a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.018534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459d849-16f4-45b1-a3dd-a5330e27c78a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.018814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459d849-16f4-45b1-a3dd-a5330e27c78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.036926 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2459d849-16f4-45b1-a3dd-a5330e27c78a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:00.038151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2459d849-16f4-45b1-a3dd-a5330e27c78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:00.106254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 160/322] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:00.166295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e23f0c-7617-41b4-a25a-0b6ef756326a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:00.170731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:00.269505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e23f0c-7617-41b4-a25a-0b6ef756326a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:00.302899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94a8f8-1eec-402a-8207-3043cfe918c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:00.303528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94a8f8-1eec-402a-8207-3043cfe918c8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.303812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94a8f8-1eec-402a-8207-3043cfe918c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.304087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94a8f8-1eec-402a-8207-3043cfe918c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.314289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94a8f8-1eec-402a-8207-3043cfe918c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7b94a8f8-1eec-402a-8207-3043cfe918c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:00.319149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:00.319993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:00.320775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:00.322408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 163/323] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:00.326516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459d849-16f4-45b1-a3dd-a5330e27c78a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:00.373968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94a8f8-1eec-402a-8207-3043cfe918c8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:00.436066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459d849-16f4-45b1-a3dd-a5330e27c78a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:00.443976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:00.456366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:00.475143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf13328-52f6-4a88-8858-c7d23fbb5bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:00.475937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf13328-52f6-4a88-8858-c7d23fbb5bbd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.476575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf13328-52f6-4a88-8858-c7d23fbb5bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.476857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf13328-52f6-4a88-8858-c7d23fbb5bbd None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.477834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf13328-52f6-4a88-8858-c7d23fbb5bbd None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:00.478170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf13328-52f6-4a88-8858-c7d23fbb5bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:00.480049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf13328-52f6-4a88-8858-c7d23fbb5bbd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:00.485626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94a8f8-1eec-402a-8207-3043cfe918c8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:00.489253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 161/324] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:43:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:00.494862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf13328-52f6-4a88-8858-c7d23fbb5bbd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:00.520391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19290-1635-41b4-b651-9b3d1e64df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:00.521019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19290-1635-41b4-b651-9b3d1e64df79 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.521300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19290-1635-41b4-b651-9b3d1e64df79 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.521570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19290-1635-41b4-b651-9b3d1e64df79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.522699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19290-1635-41b4-b651-9b3d1e64df79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:00.524152 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19290-1635-41b4-b651-9b3d1e64df79 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:00.525720 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 164/325] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:00.531564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19290-1635-41b4-b651-9b3d1e64df79 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:00.600345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf13328-52f6-4a88-8858-c7d23fbb5bbd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:00.627886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19290-1635-41b4-b651-9b3d1e64df79 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:00.633239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53310b-9a53-4f54-8890-5f2a8a370062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:00.633865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53310b-9a53-4f54-8890-5f2a8a370062 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.634177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53310b-9a53-4f54-8890-5f2a8a370062 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.634453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53310b-9a53-4f54-8890-5f2a8a370062 None admin] PATH_INFO: `/v3/users/fdcd7b19e93a449698f69daaf6e29038` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.635582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53310b-9a53-4f54-8890-5f2a8a370062 None admin] RBAC: Authorizing `identity:get_user(user_id=fdcd7b19e93a449698f69daaf6e29038)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:00.637049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53310b-9a53-4f54-8890-5f2a8a370062 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:00.638826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 162/326] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:43:00 2022] GET /identity/v3/users/fdcd7b19e93a449698f69daaf6e29038 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:00.639746 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d79026-be7f-430e-a5f6-160cc19d6c1e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.640029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d79026-be7f-430e-a5f6-160cc19d6c1e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.640303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d79026-be7f-430e-a5f6-160cc19d6c1e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.641493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 163/327] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:00.644282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d79026-be7f-430e-a5f6-160cc19d6c1e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:00.661612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:00.666365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72961673-1c37-4c41-a82b-58e42e6c710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:00.667636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72961673-1c37-4c41-a82b-58e42e6c710d None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.667919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72961673-1c37-4c41-a82b-58e42e6c710d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.668191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72961673-1c37-4c41-a82b-58e42e6c710d None admin] PATH_INFO: `/v3/groups` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.668818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72961673-1c37-4c41-a82b-58e42e6c710d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:00.670454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72961673-1c37-4c41-a82b-58e42e6c710d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:00.692092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:00.743911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d79026-be7f-430e-a5f6-160cc19d6c1e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:00.776311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9333310-369f-4298-8abe-7157d3fd7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:00.776910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9333310-369f-4298-8abe-7157d3fd7b0c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.777192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9333310-369f-4298-8abe-7157d3fd7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.777468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9333310-369f-4298-8abe-7157d3fd7b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.778228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9333310-369f-4298-8abe-7157d3fd7b0c None admin] RBAC: Adding query filter params (role.id=522cad34ce354f77b50e5490fdb6174d, user.id=fdcd7b19e93a449698f69daaf6e29038, scope.system=all) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:00.778548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9333310-369f-4298-8abe-7157d3fd7b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:00.779065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 165/328] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Oct 4 08:43:00 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:43:00.779987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9333310-369f-4298-8abe-7157d3fd7b0c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:00.783844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307590-9c0a-4295-a676-e04335eacee7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:00.783844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307590-9c0a-4295-a676-e04335eacee7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:00.783844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307590-9c0a-4295-a676-e04335eacee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:00.793140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 164/329] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Oct 4 08:43:00 2022] GET /identity/v3/role_assignments?user.id=fdcd7b19e93a449698f69daaf6e29038&scope.system=all&role.id=522cad34ce354f77b50e5490fdb6174d => generated 510 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:00.809599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-aa307590-9c0a-4295-a676-e04335eacee7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:00.811068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aa307590-9c0a-4295-a676-e04335eacee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:00.893105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 166/330] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:01.163685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9333310-369f-4298-8abe-7157d3fd7b0c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:01.268581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9333310-369f-4298-8abe-7157d3fd7b0c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:01.271309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:01.306570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f0f43-827a-4521-a96a-10a9e1bd4764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:01.307210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f0f43-827a-4521-a96a-10a9e1bd4764 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:01.307487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f0f43-827a-4521-a96a-10a9e1bd4764 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:01.308283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f0f43-827a-4521-a96a-10a9e1bd4764 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:01.319418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f0f43-827a-4521-a96a-10a9e1bd4764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c91f0f43-827a-4521-a96a-10a9e1bd4764 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:01.324879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:01.325751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:43:01.326689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:01.330196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 165/331] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:01.332184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307590-9c0a-4295-a676-e04335eacee7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:01.448781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307590-9c0a-4295-a676-e04335eacee7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:01.476890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:01.490666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe304a-12e6-409a-941d-8923b5d608d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:01.491340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe304a-12e6-409a-941d-8923b5d608d9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:01.491628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe304a-12e6-409a-941d-8923b5d608d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:01.491901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe304a-12e6-409a-941d-8923b5d608d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:01.495209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe304a-12e6-409a-941d-8923b5d608d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:01.495209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe304a-12e6-409a-941d-8923b5d608d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:01.495209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe304a-12e6-409a-941d-8923b5d608d9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:01.502895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 167/332] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:43:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:01.508610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f0f43-827a-4521-a96a-10a9e1bd4764 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:01.617301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f0f43-827a-4521-a96a-10a9e1bd4764 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:01.654272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c6614-f138-46d1-ae1b-388eea5f3b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:01.654908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c6614-f138-46d1-ae1b-388eea5f3b27 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:01.655190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c6614-f138-46d1-ae1b-388eea5f3b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:01.655466 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c6614-f138-46d1-ae1b-388eea5f3b27 None admin] PATH_INFO: `/v3/users/a11660abcec448e8951f067084f56610` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:01.656615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c6614-f138-46d1-ae1b-388eea5f3b27 None admin] RBAC: Authorizing `identity:get_user(user_id=a11660abcec448e8951f067084f56610)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:01.658059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c6614-f138-46d1-ae1b-388eea5f3b27 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:01.659886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 166/333] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:43:01 2022] GET /identity/v3/users/a11660abcec448e8951f067084f56610 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:01.665353 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe304a-12e6-409a-941d-8923b5d608d9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:01.775208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe304a-12e6-409a-941d-8923b5d608d9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:01.813677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72379ae2-a6d5-477c-9bce-827bdab9bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:01.814452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72379ae2-a6d5-477c-9bce-827bdab9bfa2 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:01.814636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72379ae2-a6d5-477c-9bce-827bdab9bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:01.814914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72379ae2-a6d5-477c-9bce-827bdab9bfa2 None admin] PATH_INFO: `/v3/system/users/a11660abcec448e8951f067084f56610/roles/d9df243cfd5148769d90f26f275d55d6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:01.816342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72379ae2-a6d5-477c-9bce-827bdab9bfa2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a11660abcec448e8951f067084f56610, role_id=d9df243cfd5148769d90f26f275d55d6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:01.817871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72379ae2-a6d5-477c-9bce-827bdab9bfa2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:01.903757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 168/334] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Oct 4 08:43:01 2022] PUT /identity/v3/system/users/a11660abcec448e8951f067084f56610/roles/d9df243cfd5148769d90f26f275d55d6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:03.278671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5c1cb-4ca6-415f-af02-1c260311955c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:03.279161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5c1cb-4ca6-415f-af02-1c260311955c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:03.279161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5c1cb-4ca6-415f-af02-1c260311955c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:03.280740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 167/335] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:03.286050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327fa04-0102-427e-b81c-bc95921cee4a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:03.286457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327fa04-0102-427e-b81c-bc95921cee4a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:03.286685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327fa04-0102-427e-b81c-bc95921cee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:03.311082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7327fa04-0102-427e-b81c-bc95921cee4a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:03.312291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7327fa04-0102-427e-b81c-bc95921cee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:03.366926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:03.399414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 169/336] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:03.862926 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dccfd-7a2b-4009-b4c0-641a538d3fcc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:03.863324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dccfd-7a2b-4009-b4c0-641a538d3fcc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:03.863525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dccfd-7a2b-4009-b4c0-641a538d3fcc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:03.865045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 168/337] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:03.871058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c60ebe-53bb-40ac-93cd-5ce1071ef41b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:03.871349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c60ebe-53bb-40ac-93cd-5ce1071ef41b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:03.871627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c60ebe-53bb-40ac-93cd-5ce1071ef41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:03.894799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d1c60ebe-53bb-40ac-93cd-5ce1071ef41b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:03.896010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d1c60ebe-53bb-40ac-93cd-5ce1071ef41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:03.985963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 170/338] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:04.002412 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dccfd-7a2b-4009-b4c0-641a538d3fcc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:04.040683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:04.123885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dccfd-7a2b-4009-b4c0-641a538d3fcc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:04.171241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690af75-0ad0-4894-a3be-02564b419479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:04.171889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690af75-0ad0-4894-a3be-02564b419479 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:04.172171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690af75-0ad0-4894-a3be-02564b419479 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:04.172445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690af75-0ad0-4894-a3be-02564b419479 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:04.184285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690af75-0ad0-4894-a3be-02564b419479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0690af75-0ad0-4894-a3be-02564b419479 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:04.190043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:04.190947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:04.191716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:04.192530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 169/339] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:04.198973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c60ebe-53bb-40ac-93cd-5ce1071ef41b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:04.217141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeece8-6769-4bbd-b892-5ce0b4f399ca None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:04.217603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeece8-6769-4bbd-b892-5ce0b4f399ca None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:04.218109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeece8-6769-4bbd-b892-5ce0b4f399ca None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:04.221303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 170/340] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:43:04.226553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e3d2e-a30a-464f-8ecf-e4d18342c5f2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:04.226839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e3d2e-a30a-464f-8ecf-e4d18342c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:04.227120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e3d2e-a30a-464f-8ecf-e4d18342c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:04.255958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-941e3d2e-a30a-464f-8ecf-e4d18342c5f2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:04.257168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-941e3d2e-a30a-464f-8ecf-e4d18342c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:04.365296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 171/341] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:04.394228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c60ebe-53bb-40ac-93cd-5ce1071ef41b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:04.407291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:04.445212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8b864-833a-4d3b-91d3-96e6939ec370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:04.445844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8b864-833a-4d3b-91d3-96e6939ec370 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:04.446149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8b864-833a-4d3b-91d3-96e6939ec370 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:04.446449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8b864-833a-4d3b-91d3-96e6939ec370 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:04.447136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8b864-833a-4d3b-91d3-96e6939ec370 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:04.447874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8b864-833a-4d3b-91d3-96e6939ec370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:04.449803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8b864-833a-4d3b-91d3-96e6939ec370 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:04.461428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 171/342] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:43:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:04.467617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e3d2e-a30a-464f-8ecf-e4d18342c5f2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:04.526914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:04.585512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8b864-833a-4d3b-91d3-96e6939ec370 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:04.654695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e3d2e-a30a-464f-8ecf-e4d18342c5f2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:04.718551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d289943-ef3b-4b8e-a19e-639d1284b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:04.719609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289943-ef3b-4b8e-a19e-639d1284b6be None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:04.719891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289943-ef3b-4b8e-a19e-639d1284b6be None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:04.720165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289943-ef3b-4b8e-a19e-639d1284b6be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:04.845934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8b864-833a-4d3b-91d3-96e6939ec370 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:04.867016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d289943-ef3b-4b8e-a19e-639d1284b6be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:04.868486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d289943-ef3b-4b8e-a19e-639d1284b6be None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:04.914001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f730e1-1190-4f8f-bf4d-2de443184f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:04.914586 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f730e1-1190-4f8f-bf4d-2de443184f58 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:04.914822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:04.914922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f730e1-1190-4f8f-bf4d-2de443184f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:04.915116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f730e1-1190-4f8f-bf4d-2de443184f58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:04.937259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f730e1-1190-4f8f-bf4d-2de443184f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c9f730e1-1190-4f8f-bf4d-2de443184f58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:04.953958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:04.954933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:04.955700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 172/343] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:43:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:04.960176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f730e1-1190-4f8f-bf4d-2de443184f58 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:05.003373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:05.034282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 172/344] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:05.035329 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d289943-ef3b-4b8e-a19e-639d1284b6be None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:05.096874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f730e1-1190-4f8f-bf4d-2de443184f58 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:05.138745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13ae9f-a7a9-43ba-8041-6d4d9233560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:05.139393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13ae9f-a7a9-43ba-8041-6d4d9233560a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.139950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13ae9f-a7a9-43ba-8041-6d4d9233560a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.140231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13ae9f-a7a9-43ba-8041-6d4d9233560a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.155272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13ae9f-a7a9-43ba-8041-6d4d9233560a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:05.160443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d289943-ef3b-4b8e-a19e-639d1284b6be None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-de13ae9f-a7a9-43ba-8041-6d4d9233560a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:05.161560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:05.162487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:05.163362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:05.163962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 173/345] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:05.165920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24436-8397-4507-b81c-d756c6bf956d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.166178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24436-8397-4507-b81c-d756c6bf956d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.166468 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24436-8397-4507-b81c-d756c6bf956d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.168720 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 174/346] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:05.170194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d24436-8397-4507-b81c-d756c6bf956d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:05.195416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:05.208605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a351b-8290-4896-ab6c-22b6b35eadf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:05.209715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a351b-8290-4896-ab6c-22b6b35eadf7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.210343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a351b-8290-4896-ab6c-22b6b35eadf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.210831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a351b-8290-4896-ab6c-22b6b35eadf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.211639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a351b-8290-4896-ab6c-22b6b35eadf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:05.212046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a351b-8290-4896-ab6c-22b6b35eadf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:05.214056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a351b-8290-4896-ab6c-22b6b35eadf7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:05.224742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 173/347] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:05.225589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a351b-8290-4896-ab6c-22b6b35eadf7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:05.286033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:05.300324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d24436-8397-4507-b81c-d756c6bf956d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:05.345538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c60d0-c188-48a9-ac79-377432ef41b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:05.346480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c60d0-c188-48a9-ac79-377432ef41b5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.346767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c60d0-c188-48a9-ac79-377432ef41b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.347044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c60d0-c188-48a9-ac79-377432ef41b5 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.348095 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a351b-8290-4896-ab6c-22b6b35eadf7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:05.348316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c60d0-c188-48a9-ac79-377432ef41b5 None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:05.349803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c60d0-c188-48a9-ac79-377432ef41b5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:05.352872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 175/348] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:05 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:05.354073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7357f2-3df7-45d4-9f42-81960031fa6c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.354995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7357f2-3df7-45d4-9f42-81960031fa6c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.355273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7357f2-3df7-45d4-9f42-81960031fa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.377917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cd7357f2-3df7-45d4-9f42-81960031fa6c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:05.379615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cd7357f2-3df7-45d4-9f42-81960031fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:05.396543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe8b1f-715b-4dfe-96d9-3701cf647576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:05.399919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8b1f-715b-4dfe-96d9-3701cf647576 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.400206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8b1f-715b-4dfe-96d9-3701cf647576 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.400488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe8b1f-715b-4dfe-96d9-3701cf647576 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.401799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe8b1f-715b-4dfe-96d9-3701cf647576 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:05.402131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe8b1f-715b-4dfe-96d9-3701cf647576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:05.403862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe8b1f-715b-4dfe-96d9-3701cf647576 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:05.414438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 174/349] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:43:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:05.415419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe8b1f-715b-4dfe-96d9-3701cf647576 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:05.469542 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 176/350] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:05.470450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7357f2-3df7-45d4-9f42-81960031fa6c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:05.473337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:05.531807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe8b1f-715b-4dfe-96d9-3701cf647576 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:05.563527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:05.568190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0db87-376b-48d1-8a5d-37a9582c3140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:05.568911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0db87-376b-48d1-8a5d-37a9582c3140 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.569216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0db87-376b-48d1-8a5d-37a9582c3140 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.569550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0db87-376b-48d1-8a5d-37a9582c3140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.576209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7357f2-3df7-45d4-9f42-81960031fa6c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:05.612891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ce0c-ef2e-4810-812b-753a5f51907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:05.613535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ce0c-ef2e-4810-812b-753a5f51907c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.613819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ce0c-ef2e-4810-812b-753a5f51907c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.614130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ce0c-ef2e-4810-812b-753a5f51907c None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.621680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2ce0c-ef2e-4810-812b-753a5f51907c None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:05.623184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2ce0c-ef2e-4810-812b-753a5f51907c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:05.624835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 177/351] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:05 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:05.625706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ce0c-ef2e-4810-812b-753a5f51907c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:05.644979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0db87-376b-48d1-8a5d-37a9582c3140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:05.646488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0db87-376b-48d1-8a5d-37a9582c3140 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:05.694208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:05.736538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ce0c-ef2e-4810-812b-753a5f51907c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:05.756493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 175/352] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:05.757853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e8f2-f0b3-49f9-8f58-e9af325b45e1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.758164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e8f2-f0b3-49f9-8f58-e9af325b45e1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.758508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836e8f2-f0b3-49f9-8f58-e9af325b45e1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.759740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 176/353] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:05.760663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836e8f2-f0b3-49f9-8f58-e9af325b45e1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:05.777324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888b307-d7d1-4c37-a348-af86d8c6ec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:05.778562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888b307-d7d1-4c37-a348-af86d8c6ec2a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.778926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888b307-d7d1-4c37-a348-af86d8c6ec2a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.779357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888b307-d7d1-4c37-a348-af86d8c6ec2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.806867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:05.873020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888b307-d7d1-4c37-a348-af86d8c6ec2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:05.874594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888b307-d7d1-4c37-a348-af86d8c6ec2a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:05.886717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836e8f2-f0b3-49f9-8f58-e9af325b45e1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:05.937202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee888d-4f75-4b54-9fbb-7665cccfe744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:05.938827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee888d-4f75-4b54-9fbb-7665cccfe744 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.939116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee888d-4f75-4b54-9fbb-7665cccfe744 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.939392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee888d-4f75-4b54-9fbb-7665cccfe744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.940144 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee888d-4f75-4b54-9fbb-7665cccfe744 None admin] RBAC: Adding query filter params (group.id=52f27c81598045d0bd137c43f4794cef, role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:05.940745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee888d-4f75-4b54-9fbb-7665cccfe744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:05.941990 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee888d-4f75-4b54-9fbb-7665cccfe744 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:05.949000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 177/354] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:05 2022] GET /identity/v3/role_assignments?group.id=52f27c81598045d0bd137c43f4794cef&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=522cad34ce354f77b50e5490fdb6174d => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:05.950792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf618b11-8e5b-4e4d-9433-27b522015370 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:05.951138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf618b11-8e5b-4e4d-9433-27b522015370 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:05.951348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf618b11-8e5b-4e4d-9433-27b522015370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:05.973434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bf618b11-8e5b-4e4d-9433-27b522015370 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:05.974726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bf618b11-8e5b-4e4d-9433-27b522015370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:05.978812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:06.005383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 178/355] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:06.006192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888b307-d7d1-4c37-a348-af86d8c6ec2a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:06.081944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:06.093449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 178/356] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:06.094951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf618b11-8e5b-4e4d-9433-27b522015370 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:06.168981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888b307-d7d1-4c37-a348-af86d8c6ec2a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:06.232431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f10871-b834-4690-a759-fb03832b9eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:06.233087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f10871-b834-4690-a759-fb03832b9eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.233369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f10871-b834-4690-a759-fb03832b9eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.233646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f10871-b834-4690-a759-fb03832b9eb9 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.234835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f10871-b834-4690-a759-fb03832b9eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:06.236606 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f10871-b834-4690-a759-fb03832b9eb9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:06.242121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 179/357] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:06.242121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1030-dbb2-4067-95c1-5014ebb47f35 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.242121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1030-dbb2-4067-95c1-5014ebb47f35 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.242121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1030-dbb2-4067-95c1-5014ebb47f35 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.242121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 180/358] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:06.242810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa1030-dbb2-4067-95c1-5014ebb47f35 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:06.253598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf618b11-8e5b-4e4d-9433-27b522015370 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:06.297529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c467e7-d330-4f03-93a2-6f76c6b2ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:06.298105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c467e7-d330-4f03-93a2-6f76c6b2ce05 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.298475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c467e7-d330-4f03-93a2-6f76c6b2ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.298752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c467e7-d330-4f03-93a2-6f76c6b2ce05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.310583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c467e7-d330-4f03-93a2-6f76c6b2ce05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-04c467e7-d330-4f03-93a2-6f76c6b2ce05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:06.315943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:06.316832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:06.317593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:06.318221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 179/359] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:06.318791 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c467e7-d330-4f03-93a2-6f76c6b2ce05 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:06.324517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:06.383788 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa1030-dbb2-4067-95c1-5014ebb47f35 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:06.408988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:06.428447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969d77-6aef-477c-b662-5bfc89f4e952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:06.429185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969d77-6aef-477c-b662-5bfc89f4e952 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.429384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969d77-6aef-477c-b662-5bfc89f4e952 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.429656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969d77-6aef-477c-b662-5bfc89f4e952 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.432215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969d77-6aef-477c-b662-5bfc89f4e952 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:06.434904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969d77-6aef-477c-b662-5bfc89f4e952 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:06.436009 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 181/360] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:06.437441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5adc80-7bf4-4f5c-a7a8-a3afbc4e19b1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.437996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5adc80-7bf4-4f5c-a7a8-a3afbc4e19b1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.438300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5adc80-7bf4-4f5c-a7a8-a3afbc4e19b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.442847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c467e7-d330-4f03-93a2-6f76c6b2ce05 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:06.469035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bc5adc80-7bf4-4f5c-a7a8-a3afbc4e19b1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:06.470435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bc5adc80-7bf4-4f5c-a7a8-a3afbc4e19b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:06.488444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076f747-d3eb-4201-bfba-e44a09bb402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:06.489422 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076f747-d3eb-4201-bfba-e44a09bb402e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.489853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076f747-d3eb-4201-bfba-e44a09bb402e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.490409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076f747-d3eb-4201-bfba-e44a09bb402e None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.495015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076f747-d3eb-4201-bfba-e44a09bb402e None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:06.496644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076f747-d3eb-4201-bfba-e44a09bb402e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:06.499190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 180/361] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:06.500203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076f747-d3eb-4201-bfba-e44a09bb402e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:06.556403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 182/362] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:06.556403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5adc80-7bf4-4f5c-a7a8-a3afbc4e19b1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:06.589976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:06.634698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076f747-d3eb-4201-bfba-e44a09bb402e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:06.684823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1b2b6-0f9f-4828-88f7-1d2f77a47a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:06.685924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1b2b6-0f9f-4828-88f7-1d2f77a47a81 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.686409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1b2b6-0f9f-4828-88f7-1d2f77a47a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.686693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1b2b6-0f9f-4828-88f7-1d2f77a47a81 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.687375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1b2b6-0f9f-4828-88f7-1d2f77a47a81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:06.687685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1b2b6-0f9f-4828-88f7-1d2f77a47a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:06.689895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1b2b6-0f9f-4828-88f7-1d2f77a47a81 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:06.693670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5adc80-7bf4-4f5c-a7a8-a3afbc4e19b1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:06.701735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 181/363] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:06.702726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1b2b6-0f9f-4828-88f7-1d2f77a47a81 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:06.721383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:06.743190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162c1f-cddf-4796-a194-93445d62089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:06.743899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162c1f-cddf-4796-a194-93445d62089d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.746840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162c1f-cddf-4796-a194-93445d62089d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.746840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162c1f-cddf-4796-a194-93445d62089d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.758509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0162c1f-cddf-4796-a194-93445d62089d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b0162c1f-cddf-4796-a194-93445d62089d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:06.764203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:06.765089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:06.765907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 183/364] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:06.771354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162c1f-cddf-4796-a194-93445d62089d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:06.845030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1b2b6-0f9f-4828-88f7-1d2f77a47a81 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:06.883423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:06.894213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d706722-3a46-45fc-a160-045f7ce13aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:06.904096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d706722-3a46-45fc-a160-045f7ce13aef None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.904096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d706722-3a46-45fc-a160-045f7ce13aef None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.904096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d706722-3a46-45fc-a160-045f7ce13aef None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.904096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d706722-3a46-45fc-a160-045f7ce13aef None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:06.904096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d706722-3a46-45fc-a160-045f7ce13aef None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:06.904096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 182/365] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:06.904519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d706722-3a46-45fc-a160-045f7ce13aef None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:06.918744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162c1f-cddf-4796-a194-93445d62089d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:06.969829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff24334-5d3c-414e-ace2-8a672a7d341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:06.970474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff24334-5d3c-414e-ace2-8a672a7d341b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:06.970756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff24334-5d3c-414e-ace2-8a672a7d341b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:06.971029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff24334-5d3c-414e-ace2-8a672a7d341b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:06.971759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff24334-5d3c-414e-ace2-8a672a7d341b None admin] RBAC: Adding query filter params (group.id=52f27c81598045d0bd137c43f4794cef, role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:06.972064 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff24334-5d3c-414e-ace2-8a672a7d341b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:06.973500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff24334-5d3c-414e-ace2-8a672a7d341b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:06.981044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 184/366] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/role_assignments?group.id=52f27c81598045d0bd137c43f4794cef&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:06.982034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff24334-5d3c-414e-ace2-8a672a7d341b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:07.043040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:07.043820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d706722-3a46-45fc-a160-045f7ce13aef None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:07.090150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb489f-5dca-473a-9d93-fbdd61021340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:07.091039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb489f-5dca-473a-9d93-fbdd61021340 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:07.091556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb489f-5dca-473a-9d93-fbdd61021340 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:07.092043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb489f-5dca-473a-9d93-fbdd61021340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:07.125806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff24334-5d3c-414e-ace2-8a672a7d341b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:07.179588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9ac44-763d-4092-a4fc-69de8adb09b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:07.180691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ac44-763d-4092-a4fc-69de8adb09b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:07.181176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ac44-763d-4092-a4fc-69de8adb09b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:07.181652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ac44-763d-4092-a4fc-69de8adb09b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:07.183289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9ac44-763d-4092-a4fc-69de8adb09b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:07.183936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9ac44-763d-4092-a4fc-69de8adb09b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:07.185615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9ac44-763d-4092-a4fc-69de8adb09b7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:07.189375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:07.192770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb489f-5dca-473a-9d93-fbdd61021340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:07.194282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb489f-5dca-473a-9d93-fbdd61021340 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:07.199111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 185/367] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:07.199980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9ac44-763d-4092-a4fc-69de8adb09b7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:07.316712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 183/368] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:07.317387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb489f-5dca-473a-9d93-fbdd61021340 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:07.344939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9ac44-763d-4092-a4fc-69de8adb09b7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:07.355355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:07.393267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6d364-8af0-493b-b9e0-8a0ea8118635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:07.393837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6d364-8af0-493b-b9e0-8a0ea8118635 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:07.394211 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6d364-8af0-493b-b9e0-8a0ea8118635 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:07.395579 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6d364-8af0-493b-b9e0-8a0ea8118635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:07.409475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6d364-8af0-493b-b9e0-8a0ea8118635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-98f6d364-8af0-493b-b9e0-8a0ea8118635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:07.416138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:07.417611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 186/369] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:07.419369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6d364-8af0-493b-b9e0-8a0ea8118635 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:07.431145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:07.436257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb489f-5dca-473a-9d93-fbdd61021340 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:07.479015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e8bdc-3e01-4bda-8d51-c0d7ea4489eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:07.479813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e8bdc-3e01-4bda-8d51-c0d7ea4489eb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:07.480208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e8bdc-3e01-4bda-8d51-c0d7ea4489eb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:07.480545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e8bdc-3e01-4bda-8d51-c0d7ea4489eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:07.481729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e8bdc-3e01-4bda-8d51-c0d7ea4489eb None admin] RBAC: Adding query filter params (group.id=52f27c81598045d0bd137c43f4794cef, role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=2128b23359fb4df3954335bb9c1edc4e) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:07.482188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e8bdc-3e01-4bda-8d51-c0d7ea4489eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:07.483829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e8bdc-3e01-4bda-8d51-c0d7ea4489eb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:07.490554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 184/370] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:07 2022] GET /identity/v3/role_assignments?group.id=52f27c81598045d0bd137c43f4794cef&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=522cad34ce354f77b50e5490fdb6174d => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:07.491518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e8bdc-3e01-4bda-8d51-c0d7ea4489eb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:07.594457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6d364-8af0-493b-b9e0-8a0ea8118635 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:07.644811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23edc4-c713-4319-a875-e2555dd5a9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:07.646621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23edc4-c713-4319-a875-e2555dd5a9fc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:07.646908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23edc4-c713-4319-a875-e2555dd5a9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:07.647187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23edc4-c713-4319-a875-e2555dd5a9fc None admin] PATH_INFO: `/v3/users/a11660abcec448e8951f067084f56610` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:07.648683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23edc4-c713-4319-a875-e2555dd5a9fc None admin] RBAC: Authorizing `identity:get_user(user_id=a11660abcec448e8951f067084f56610)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:07.650197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23edc4-c713-4319-a875-e2555dd5a9fc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:07.655990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 187/371] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:43:07 2022] GET /identity/v3/users/a11660abcec448e8951f067084f56610 => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:07.656846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23edc4-c713-4319-a875-e2555dd5a9fc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:07.679853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e8bdc-3e01-4bda-8d51-c0d7ea4489eb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:07.723996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:07.751358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f170bd-29b7-46f5-9e98-8da80f79e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:07.752028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f170bd-29b7-46f5-9e98-8da80f79e408 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:07.752307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f170bd-29b7-46f5-9e98-8da80f79e408 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:07.752639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f170bd-29b7-46f5-9e98-8da80f79e408 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:07.756218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f170bd-29b7-46f5-9e98-8da80f79e408 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:07.757950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f170bd-29b7-46f5-9e98-8da80f79e408 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:07.760376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 185/372] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:07 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:07.761631 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f170bd-29b7-46f5-9e98-8da80f79e408 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:07.820216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:07.834366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23edc4-c713-4319-a875-e2555dd5a9fc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:07.881267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4454e59-def8-4ca4-8432-641ad8d0802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:07.881922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4454e59-def8-4ca4-8432-641ad8d0802d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:07.882238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4454e59-def8-4ca4-8432-641ad8d0802d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:07.882517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4454e59-def8-4ca4-8432-641ad8d0802d None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:07.883202 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4454e59-def8-4ca4-8432-641ad8d0802d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:07.885957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4454e59-def8-4ca4-8432-641ad8d0802d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:07.887507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4454e59-def8-4ca4-8432-641ad8d0802d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:07.896680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 188/373] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:07.897355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4454e59-def8-4ca4-8432-641ad8d0802d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:07.918779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f170bd-29b7-46f5-9e98-8da80f79e408 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:07.960150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb045302-5054-46c2-a762-3d18d2d62c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:07.960817 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb045302-5054-46c2-a762-3d18d2d62c2d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:07.961099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb045302-5054-46c2-a762-3d18d2d62c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:07.961416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb045302-5054-46c2-a762-3d18d2d62c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:07.962311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb045302-5054-46c2-a762-3d18d2d62c2d None admin] RBAC: Adding query filter params (role.id=d9df243cfd5148769d90f26f275d55d6, user.id=a11660abcec448e8951f067084f56610, scope.system=all) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:07.962697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb045302-5054-46c2-a762-3d18d2d62c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:07.964862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb045302-5054-46c2-a762-3d18d2d62c2d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:07.979614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 186/374] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Oct 4 08:43:07 2022] GET /identity/v3/role_assignments?user.id=a11660abcec448e8951f067084f56610&scope.system=all&role.id=d9df243cfd5148769d90f26f275d55d6 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:07.980782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb045302-5054-46c2-a762-3d18d2d62c2d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:08.031595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:08.051860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4454e59-def8-4ca4-8432-641ad8d0802d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:08.093863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2674ad-504f-40d5-840b-e59a6c3f4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:08.094591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2674ad-504f-40d5-840b-e59a6c3f4e4c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:08.094871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2674ad-504f-40d5-840b-e59a6c3f4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:08.095147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2674ad-504f-40d5-840b-e59a6c3f4e4c None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:08.097247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2674ad-504f-40d5-840b-e59a6c3f4e4c None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:08.099071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2674ad-504f-40d5-840b-e59a6c3f4e4c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:08.101423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 189/375] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:07 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:08.107149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2674ad-504f-40d5-840b-e59a6c3f4e4c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:08.146293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:08.163168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb045302-5054-46c2-a762-3d18d2d62c2d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:08.207452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8945fd-80f0-4f22-a325-9c3ca52a9302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:08.208157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8945fd-80f0-4f22-a325-9c3ca52a9302 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:08.208442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8945fd-80f0-4f22-a325-9c3ca52a9302 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:08.208715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8945fd-80f0-4f22-a325-9c3ca52a9302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:08.277503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2674ad-504f-40d5-840b-e59a6c3f4e4c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:08.288121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8945fd-80f0-4f22-a325-9c3ca52a9302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:08.289668 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8945fd-80f0-4f22-a325-9c3ca52a9302 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:08.336231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913237b4-6051-48fb-a5fa-5bff0042650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:08.336895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913237b4-6051-48fb-a5fa-5bff0042650d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:08.337125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913237b4-6051-48fb-a5fa-5bff0042650d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:08.337399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913237b4-6051-48fb-a5fa-5bff0042650d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:08.338156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913237b4-6051-48fb-a5fa-5bff0042650d None admin] RBAC: Adding query filter params (group.id=52f27c81598045d0bd137c43f4794cef, role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=2128b23359fb4df3954335bb9c1edc4e) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:08.338507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913237b4-6051-48fb-a5fa-5bff0042650d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:08.339963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913237b4-6051-48fb-a5fa-5bff0042650d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:08.350974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 190/376] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:08 2022] GET /identity/v3/role_assignments?group.id=52f27c81598045d0bd137c43f4794cef&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:08.386466 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:08.401322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 187/377] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:08.408434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913237b4-6051-48fb-a5fa-5bff0042650d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:08.471017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:08.551458 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913237b4-6051-48fb-a5fa-5bff0042650d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:08.598964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f53b0d-5c05-42d7-8525-62e42db5ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:08.599606 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f53b0d-5c05-42d7-8525-62e42db5ec15 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:08.599887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f53b0d-5c05-42d7-8525-62e42db5ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:08.600161 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f53b0d-5c05-42d7-8525-62e42db5ec15 None admin] PATH_INFO: `/v3/projects/ebfb49c53afc43dab99fad98da6b3e94` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:08.601415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f53b0d-5c05-42d7-8525-62e42db5ec15 None admin] RBAC: Authorizing `identity:get_project(project_id=ebfb49c53afc43dab99fad98da6b3e94)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:08.602943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f53b0d-5c05-42d7-8525-62e42db5ec15 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:08.605493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 191/378] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:08 2022] GET /identity/v3/projects/ebfb49c53afc43dab99fad98da6b3e94 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:08.615276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8945fd-80f0-4f22-a325-9c3ca52a9302 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:08.743597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8945fd-80f0-4f22-a325-9c3ca52a9302 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:08.764768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c2e2d-3028-4e9a-988f-5596f40b4985 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:08.765080 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c2e2d-3028-4e9a-988f-5596f40b4985 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:08.765361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c2e2d-3028-4e9a-988f-5596f40b4985 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:08.766988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 192/379] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:08.774460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e799c0-8eb2-4c6a-bb87-bd31134847e9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:08.774743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e799c0-8eb2-4c6a-bb87-bd31134847e9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:08.775013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e799c0-8eb2-4c6a-bb87-bd31134847e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:08.780875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e34c3-effe-4731-9d19-2dd981958ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:08.781623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e34c3-effe-4731-9d19-2dd981958ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:08.781906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e34c3-effe-4731-9d19-2dd981958ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:08.782208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e34c3-effe-4731-9d19-2dd981958ff0 None admin] PATH_INFO: `/v3/groups/4a429e47eb33488f999fd6d649de2bce` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:08.788669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e34c3-effe-4731-9d19-2dd981958ff0 None admin] RBAC: Authorizing `identity:get_group(group_id=4a429e47eb33488f999fd6d649de2bce)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:08.790148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e34c3-effe-4731-9d19-2dd981958ff0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:08.792174 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 188/380] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:08 2022] GET /identity/v3/groups/4a429e47eb33488f999fd6d649de2bce => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:08.799832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-19e799c0-8eb2-4c6a-bb87-bd31134847e9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:08.800120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e34c3-effe-4731-9d19-2dd981958ff0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:08.801173 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-19e799c0-8eb2-4c6a-bb87-bd31134847e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:08.876373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 193/381] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:08.879095 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:08.959214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e34c3-effe-4731-9d19-2dd981958ff0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:09.007914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26bd37-f848-4fd5-998f-b7b8ebccf980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:09.008484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26bd37-f848-4fd5-998f-b7b8ebccf980 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:09.008766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26bd37-f848-4fd5-998f-b7b8ebccf980 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:09.009037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26bd37-f848-4fd5-998f-b7b8ebccf980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:09.009763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26bd37-f848-4fd5-998f-b7b8ebccf980 None admin] RBAC: Adding query filter params (group.id=4a429e47eb33488f999fd6d649de2bce, role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=ebfb49c53afc43dab99fad98da6b3e94) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:09.010095 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26bd37-f848-4fd5-998f-b7b8ebccf980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:09.011553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26bd37-f848-4fd5-998f-b7b8ebccf980 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:09.022303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 189/382] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:08 2022] GET /identity/v3/role_assignments?group.id=4a429e47eb33488f999fd6d649de2bce&scope.project.id=ebfb49c53afc43dab99fad98da6b3e94&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:09.163644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e799c0-8eb2-4c6a-bb87-bd31134847e9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:09.190969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:09.271786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e799c0-8eb2-4c6a-bb87-bd31134847e9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:09.308095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1f86-49f9-4257-869f-de820072c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:09.308754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1f86-49f9-4257-869f-de820072c6dd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:09.309033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1f86-49f9-4257-869f-de820072c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:09.309347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1f86-49f9-4257-869f-de820072c6dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:09.321085 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1f86-49f9-4257-869f-de820072c6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8faa1f86-49f9-4257-869f-de820072c6dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:09.326583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:09.327524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:09.329364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 194/383] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:09.333942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26bd37-f848-4fd5-998f-b7b8ebccf980 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:09.458213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26bd37-f848-4fd5-998f-b7b8ebccf980 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:09.486437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:09.500995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63f4fc-a34f-42a1-8c59-0524348bbe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:09.505181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63f4fc-a34f-42a1-8c59-0524348bbe70 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:09.505181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63f4fc-a34f-42a1-8c59-0524348bbe70 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:09.505181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63f4fc-a34f-42a1-8c59-0524348bbe70 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:09.505181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63f4fc-a34f-42a1-8c59-0524348bbe70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:09.505181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63f4fc-a34f-42a1-8c59-0524348bbe70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:09.505181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63f4fc-a34f-42a1-8c59-0524348bbe70 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:09.514220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 190/384] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:43:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:09.523406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1f86-49f9-4257-869f-de820072c6dd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:09.652950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:09.672087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1f86-49f9-4257-869f-de820072c6dd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:09.712781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19dc1e-4788-4f4f-9dba-ea374b6b2a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:09.713976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19dc1e-4788-4f4f-9dba-ea374b6b2a32 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:09.714288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19dc1e-4788-4f4f-9dba-ea374b6b2a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:09.714567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19dc1e-4788-4f4f-9dba-ea374b6b2a32 None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:09.715687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19dc1e-4788-4f4f-9dba-ea374b6b2a32 None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:09.717151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19dc1e-4788-4f4f-9dba-ea374b6b2a32 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:09.724793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 195/385] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:09 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:09.725787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63f4fc-a34f-42a1-8c59-0524348bbe70 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:09.761518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe845ec6-7e15-41eb-8a7b-da0d758da6ce None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:09.772454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe845ec6-7e15-41eb-8a7b-da0d758da6ce None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:09.772454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe845ec6-7e15-41eb-8a7b-da0d758da6ce None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:09.772454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 196/386] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:09.772454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f2a0e-a780-49dd-8b58-ba42c684aae9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:09.772454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f2a0e-a780-49dd-8b58-ba42c684aae9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:09.772454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f2a0e-a780-49dd-8b58-ba42c684aae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:09.789010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a77f2a0e-a780-49dd-8b58-ba42c684aae9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:09.790520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a77f2a0e-a780-49dd-8b58-ba42c684aae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:09.902626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63f4fc-a34f-42a1-8c59-0524348bbe70 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:09.921701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 197/387] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:09.944703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15462e-b6d7-44b1-8706-117dde5c0990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:09.945341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15462e-b6d7-44b1-8706-117dde5c0990 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:09.945618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15462e-b6d7-44b1-8706-117dde5c0990 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:09.945889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15462e-b6d7-44b1-8706-117dde5c0990 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:09.947029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15462e-b6d7-44b1-8706-117dde5c0990 None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:09.949125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15462e-b6d7-44b1-8706-117dde5c0990 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:09.951216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 191/388] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:09 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:09.956913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f2a0e-a780-49dd-8b58-ba42c684aae9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:10.064916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:10.083762 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f2a0e-a780-49dd-8b58-ba42c684aae9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:10.131667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdb731-1e8b-49a5-b526-32b365b49cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:10.132340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdb731-1e8b-49a5-b526-32b365b49cde None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:10.132620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdb731-1e8b-49a5-b526-32b365b49cde None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:10.132892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdb731-1e8b-49a5-b526-32b365b49cde None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/groups/52f27c81598045d0bd137c43f4794cef/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:10.134857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdb731-1e8b-49a5-b526-32b365b49cde None admin] RBAC: Authorizing `identity:create_grant(project_id=8cef5622f4fc4c5d96c4ccb770698d16, group_id=52f27c81598045d0bd137c43f4794cef, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:10.136347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdb731-1e8b-49a5-b526-32b365b49cde None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:10.223169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 198/389] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 08:43:09 2022] PUT /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/groups/52f27c81598045d0bd137c43f4794cef/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:10.326632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15462e-b6d7-44b1-8706-117dde5c0990 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:10.386516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:10.458852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15462e-b6d7-44b1-8706-117dde5c0990 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:10.503364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccd88e-f8a4-4647-9ce9-075173bf4e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:10.504394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccd88e-f8a4-4647-9ce9-075173bf4e27 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:10.504901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccd88e-f8a4-4647-9ce9-075173bf4e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:10.505373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccd88e-f8a4-4647-9ce9-075173bf4e27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:10.519869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccd88e-f8a4-4647-9ce9-075173bf4e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-dfccd88e-f8a4-4647-9ce9-075173bf4e27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:10.525099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:10.526578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:10.527408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:10.529933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 192/390] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:43:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:10.535942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdb731-1e8b-49a5-b526-32b365b49cde None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:10.645814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdb731-1e8b-49a5-b526-32b365b49cde None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:10.681993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197080a-81d5-48a9-a408-383bcd648745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:10.683452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197080a-81d5-48a9-a408-383bcd648745 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:10.683957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197080a-81d5-48a9-a408-383bcd648745 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:10.684416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197080a-81d5-48a9-a408-383bcd648745 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:10.685291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197080a-81d5-48a9-a408-383bcd648745 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:10.685796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197080a-81d5-48a9-a408-383bcd648745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:10.687386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197080a-81d5-48a9-a408-383bcd648745 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:10.696343 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 199/391] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:10.702664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccd88e-f8a4-4647-9ce9-075173bf4e27 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:10.825686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccd88e-f8a4-4647-9ce9-075173bf4e27 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:10.840565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:10.850998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca0cf-df4b-4108-a509-a58e503633d1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:10.851282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca0cf-df4b-4108-a509-a58e503633d1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:10.851549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ca0cf-df4b-4108-a509-a58e503633d1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:10.853045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 200/392] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:10.862217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85d3b-ada6-4d9a-bd06-46e162bd04b1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:10.865980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85d3b-ada6-4d9a-bd06-46e162bd04b1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:10.865980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85d3b-ada6-4d9a-bd06-46e162bd04b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:10.873214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:10.880446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b594d-4fc5-4bcd-998d-1b4cb96fe061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:10.881099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b594d-4fc5-4bcd-998d-1b4cb96fe061 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:10.881380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b594d-4fc5-4bcd-998d-1b4cb96fe061 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:10.881653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b594d-4fc5-4bcd-998d-1b4cb96fe061 None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:10.882855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b594d-4fc5-4bcd-998d-1b4cb96fe061 None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:10.884297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b594d-4fc5-4bcd-998d-1b4cb96fe061 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:10.886707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 193/393] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:10 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:10.889468 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-90a85d3b-ada6-4d9a-bd06-46e162bd04b1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:10.891053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-90a85d3b-ada6-4d9a-bd06-46e162bd04b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:10.892407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b594d-4fc5-4bcd-998d-1b4cb96fe061 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:10.987609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 201/394] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:11.024713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b594d-4fc5-4bcd-998d-1b4cb96fe061 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:11.065151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d66e1-0804-4c04-82d3-46564144e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:11.066136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d66e1-0804-4c04-82d3-46564144e519 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:11.066611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d66e1-0804-4c04-82d3-46564144e519 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:11.067072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d66e1-0804-4c04-82d3-46564144e519 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:11.068431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d66e1-0804-4c04-82d3-46564144e519 None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:11.070124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d66e1-0804-4c04-82d3-46564144e519 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:11.072002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 194/395] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:10 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:11.078621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a85d3b-ada6-4d9a-bd06-46e162bd04b1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:11.208140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a85d3b-ada6-4d9a-bd06-46e162bd04b1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:11.247301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0ba06-58b4-4bcc-819d-754c7bd023bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:11.247972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0ba06-58b4-4bcc-819d-754c7bd023bc None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:11.248251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0ba06-58b4-4bcc-819d-754c7bd023bc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:11.248521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0ba06-58b4-4bcc-819d-754c7bd023bc None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/groups/52f27c81598045d0bd137c43f4794cef/roles/b622a13d8d0c4e4c832e8e3d20466938` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:11.250764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0ba06-58b4-4bcc-819d-754c7bd023bc None admin] RBAC: Authorizing `identity:create_grant(project_id=8cef5622f4fc4c5d96c4ccb770698d16, group_id=52f27c81598045d0bd137c43f4794cef, role_id=b622a13d8d0c4e4c832e8e3d20466938)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:11.252204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0ba06-58b4-4bcc-819d-754c7bd023bc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:11.254339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:11.310818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d66e1-0804-4c04-82d3-46564144e519 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:11.320370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 202/396] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 08:43:11 2022] PUT /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16/groups/52f27c81598045d0bd137c43f4794cef/roles/b622a13d8d0c4e4c832e8e3d20466938 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:11.327954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49106966-b2a3-450b-a949-3e6cb2137edb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:11.330027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49106966-b2a3-450b-a949-3e6cb2137edb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:11.330027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49106966-b2a3-450b-a949-3e6cb2137edb None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:11.330330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 203/397] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:11.342813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5f9f-f934-4eb4-b0f8-2a6cb2ea97bf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:11.343138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5f9f-f934-4eb4-b0f8-2a6cb2ea97bf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:11.343367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5f9f-f934-4eb4-b0f8-2a6cb2ea97bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:11.371272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-413c5f9f-f934-4eb4-b0f8-2a6cb2ea97bf None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:11.372525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-413c5f9f-f934-4eb4-b0f8-2a6cb2ea97bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:11.389828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:11.493074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d66e1-0804-4c04-82d3-46564144e519 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:11.510341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 204/398] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:11.538289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb958-19e1-4958-8689-261cdde8e6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:11.538931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb958-19e1-4958-8689-261cdde8e6ff None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:11.539212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb958-19e1-4958-8689-261cdde8e6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:11.539487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cb958-19e1-4958-8689-261cdde8e6ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:11.550482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cb958-19e1-4958-8689-261cdde8e6ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8b8cb958-19e1-4958-8689-261cdde8e6ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:11.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:11.556244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:11.557078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:11.561819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 195/399] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:11.563195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5f9f-f934-4eb4-b0f8-2a6cb2ea97bf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:11.676652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5f9f-f934-4eb4-b0f8-2a6cb2ea97bf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:11.711159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:11.724425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa997e7-ca86-41d8-8c50-106819dcafa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:11.730272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa997e7-ca86-41d8-8c50-106819dcafa1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:11.730272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa997e7-ca86-41d8-8c50-106819dcafa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:11.730272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa997e7-ca86-41d8-8c50-106819dcafa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:11.730272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa997e7-ca86-41d8-8c50-106819dcafa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:11.730272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa997e7-ca86-41d8-8c50-106819dcafa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:11.730272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa997e7-ca86-41d8-8c50-106819dcafa1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:11.742206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 205/400] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:43:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:11.748639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb958-19e1-4958-8689-261cdde8e6ff None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:11.825005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa997e7-ca86-41d8-8c50-106819dcafa1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:11.881941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cb958-19e1-4958-8689-261cdde8e6ff None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:11.887846 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:11.946466 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24bf2-2f4d-47ab-920e-b6e4092e7c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:11.947104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24bf2-2f4d-47ab-920e-b6e4092e7c9d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:11.947379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24bf2-2f4d-47ab-920e-b6e4092e7c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:11.948198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24bf2-2f4d-47ab-920e-b6e4092e7c9d None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:11.950637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24bf2-2f4d-47ab-920e-b6e4092e7c9d None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:11.952089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24bf2-2f4d-47ab-920e-b6e4092e7c9d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:11.955131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 196/401] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:11 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:11.960939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24bf2-2f4d-47ab-920e-b6e4092e7c9d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:12.004842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa997e7-ca86-41d8-8c50-106819dcafa1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:12.051469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52937e-b93a-4f02-9618-a79c8245cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:12.052498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52937e-b93a-4f02-9618-a79c8245cd6d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:12.053001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52937e-b93a-4f02-9618-a79c8245cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:12.053475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52937e-b93a-4f02-9618-a79c8245cd6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:12.065278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52937e-b93a-4f02-9618-a79c8245cd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1e52937e-b93a-4f02-9618-a79c8245cd6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:12.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:12.072535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:12.074013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:12.077164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 206/402] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:43:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:12.085330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52937e-b93a-4f02-9618-a79c8245cd6d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:12.133864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24bf2-2f4d-47ab-920e-b6e4092e7c9d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:12.142928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:12.202764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645d55-883d-4eff-a6b7-dfcd99ff33c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:12.203799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645d55-883d-4eff-a6b7-dfcd99ff33c6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:12.205652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645d55-883d-4eff-a6b7-dfcd99ff33c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:12.206168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645d55-883d-4eff-a6b7-dfcd99ff33c6 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:12.208491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645d55-883d-4eff-a6b7-dfcd99ff33c6 None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:12.211596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645d55-883d-4eff-a6b7-dfcd99ff33c6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:12.214431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 197/403] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:11 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:12.219862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849719-2847-4a4d-838b-d3153c2dcc05 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:12.220357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849719-2847-4a4d-838b-d3153c2dcc05 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:12.220829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d849719-2847-4a4d-838b-d3153c2dcc05 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:12.222816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 198/404] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:12.225709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849719-2847-4a4d-838b-d3153c2dcc05 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:12.238785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52937e-b93a-4f02-9618-a79c8245cd6d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:12.271999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae1aa9-8087-400b-b3b0-157128e7ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:12.272537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae1aa9-8087-400b-b3b0-157128e7ec01 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:12.272815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae1aa9-8087-400b-b3b0-157128e7ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:12.273087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae1aa9-8087-400b-b3b0-157128e7ec01 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:12.273755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae1aa9-8087-400b-b3b0-157128e7ec01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:12.274055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae1aa9-8087-400b-b3b0-157128e7ec01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:12.275466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae1aa9-8087-400b-b3b0-157128e7ec01 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:12.276467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:12.292311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 207/405] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:12.293616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a8621-b010-4b82-a8fb-d171a7e926ac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:12.293905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a8621-b010-4b82-a8fb-d171a7e926ac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:12.294217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a8621-b010-4b82-a8fb-d171a7e926ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:12.312473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-042a8621-b010-4b82-a8fb-d171a7e926ac None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:12.313659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-042a8621-b010-4b82-a8fb-d171a7e926ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:12.351993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d849719-2847-4a4d-838b-d3153c2dcc05 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:12.386458 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 208/406] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:12.387700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a8621-b010-4b82-a8fb-d171a7e926ac None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:12.397986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16a419-76ad-4e5a-80fc-c7fee994bd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:12.399094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16a419-76ad-4e5a-80fc-c7fee994bd17 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:12.399660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16a419-76ad-4e5a-80fc-c7fee994bd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:12.400575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16a419-76ad-4e5a-80fc-c7fee994bd17 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e/groups/52f27c81598045d0bd137c43f4794cef/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:12.407703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16a419-76ad-4e5a-80fc-c7fee994bd17 None admin] RBAC: Authorizing `identity:create_grant(project_id=2128b23359fb4df3954335bb9c1edc4e, group_id=52f27c81598045d0bd137c43f4794cef, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:12.409446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16a419-76ad-4e5a-80fc-c7fee994bd17 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:12.450429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:12.506896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a8621-b010-4b82-a8fb-d171a7e926ac None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:12.526466 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 199/407] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 08:43:12 2022] PUT /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e/groups/52f27c81598045d0bd137c43f4794cef/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:12.579205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9b533-ce88-4dab-9fc5-4339c911bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:12.580364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9b533-ce88-4dab-9fc5-4339c911bdfc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:12.580851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9b533-ce88-4dab-9fc5-4339c911bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:12.581440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9b533-ce88-4dab-9fc5-4339c911bdfc None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:12.582870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9b533-ce88-4dab-9fc5-4339c911bdfc None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:12.584560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9b533-ce88-4dab-9fc5-4339c911bdfc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:12.586381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 209/408] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:12 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:12.592785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16a419-76ad-4e5a-80fc-c7fee994bd17 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:12.716060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9b533-ce88-4dab-9fc5-4339c911bdfc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:12.738896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:12.744108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16a419-76ad-4e5a-80fc-c7fee994bd17 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:12.781278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bedd4-a368-44c5-9887-8d9ad4a6a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:12.781948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bedd4-a368-44c5-9887-8d9ad4a6a69f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:12.782265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bedd4-a368-44c5-9887-8d9ad4a6a69f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:12.782543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bedd4-a368-44c5-9887-8d9ad4a6a69f None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:12.783888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bedd4-a368-44c5-9887-8d9ad4a6a69f None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:12.785334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bedd4-a368-44c5-9887-8d9ad4a6a69f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:12.787482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 200/409] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:12 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:12.796200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bedd4-a368-44c5-9887-8d9ad4a6a69f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:12.873678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9b533-ce88-4dab-9fc5-4339c911bdfc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:12.882101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:12.919096 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cefb4-b282-4ee9-9df5-3b7841132c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:12.919786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cefb4-b282-4ee9-9df5-3b7841132c34 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:12.920071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cefb4-b282-4ee9-9df5-3b7841132c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:12.920351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cefb4-b282-4ee9-9df5-3b7841132c34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:12.934015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cefb4-b282-4ee9-9df5-3b7841132c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9b9cefb4-b282-4ee9-9df5-3b7841132c34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:12.941949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:12.942851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:12.943613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 210/410] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:12.950412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cefb4-b282-4ee9-9df5-3b7841132c34 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:12.993077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bedd4-a368-44c5-9887-8d9ad4a6a69f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:13.048113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ce0e1-648a-43e8-936c-68be86d08d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:13.048799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce0e1-648a-43e8-936c-68be86d08d29 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.049083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce0e1-648a-43e8-936c-68be86d08d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.049456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ce0e1-648a-43e8-936c-68be86d08d29 None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e/groups/52f27c81598045d0bd137c43f4794cef/roles/b622a13d8d0c4e4c832e8e3d20466938` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:13.051744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ce0e1-648a-43e8-936c-68be86d08d29 None admin] RBAC: Authorizing `identity:create_grant(project_id=2128b23359fb4df3954335bb9c1edc4e, group_id=52f27c81598045d0bd137c43f4794cef, role_id=b622a13d8d0c4e4c832e8e3d20466938)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:13.053275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ce0e1-648a-43e8-936c-68be86d08d29 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:13.059237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cefb4-b282-4ee9-9df5-3b7841132c34 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:13.094396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c3eab-f7da-41a6-a5a9-db7208f98950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:13.095036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c3eab-f7da-41a6-a5a9-db7208f98950 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.095323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c3eab-f7da-41a6-a5a9-db7208f98950 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.095638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c3eab-f7da-41a6-a5a9-db7208f98950 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:13.096315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c3eab-f7da-41a6-a5a9-db7208f98950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:13.096625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c3eab-f7da-41a6-a5a9-db7208f98950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:13.098008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c3eab-f7da-41a6-a5a9-db7208f98950 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:13.107514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 211/411] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:13.108816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358cbe9-a198-43ce-8002-38e5d019bfa1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.109144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358cbe9-a198-43ce-8002-38e5d019bfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.109477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358cbe9-a198-43ce-8002-38e5d019bfa1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:13.114132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 212/412] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:13.114132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358cbe9-a198-43ce-8002-38e5d019bfa1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:13.129106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 201/413] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 08:43:12 2022] PUT /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e/groups/52f27c81598045d0bd137c43f4794cef/roles/b622a13d8d0c4e4c832e8e3d20466938 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:43:13.136442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc591aac-d93d-4be7-b005-a66bb6f8c159 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.137103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc591aac-d93d-4be7-b005-a66bb6f8c159 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.137616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc591aac-d93d-4be7-b005-a66bb6f8c159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:13.151841 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:13.176935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bc591aac-d93d-4be7-b005-a66bb6f8c159 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:13.178618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc591aac-d93d-4be7-b005-a66bb6f8c159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:13.239098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:13.265621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358cbe9-a198-43ce-8002-38e5d019bfa1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:13.326364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f591d32-a532-4fd8-85dd-643d71ae3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:13.327793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f591d32-a532-4fd8-85dd-643d71ae3862 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.328474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f591d32-a532-4fd8-85dd-643d71ae3862 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.329172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f591d32-a532-4fd8-85dd-643d71ae3862 None admin] PATH_INFO: `/v3/groups/4a429e47eb33488f999fd6d649de2bce` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:13.331281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f591d32-a532-4fd8-85dd-643d71ae3862 None admin] RBAC: Authorizing `identity:get_group(group_id=4a429e47eb33488f999fd6d649de2bce)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:13.335335 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f591d32-a532-4fd8-85dd-643d71ae3862 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:13.339101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 213/414] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:13 2022] GET /identity/v3/groups/4a429e47eb33488f999fd6d649de2bce => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:13.351478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f591d32-a532-4fd8-85dd-643d71ae3862 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:13.382182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 202/415] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:13.487205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:13.494273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f591d32-a532-4fd8-85dd-643d71ae3862 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:13.532467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693d8ff-3cee-43a7-b587-2526824778dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:13.533506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d8ff-3cee-43a7-b587-2526824778dd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.534019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d8ff-3cee-43a7-b587-2526824778dd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.534619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d8ff-3cee-43a7-b587-2526824778dd None admin] PATH_INFO: `/v3/projects/ebfb49c53afc43dab99fad98da6b3e94` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:13.536032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693d8ff-3cee-43a7-b587-2526824778dd None admin] RBAC: Authorizing `identity:get_project(project_id=ebfb49c53afc43dab99fad98da6b3e94)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:13.537706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693d8ff-3cee-43a7-b587-2526824778dd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:13.539999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 214/416] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:13 2022] GET /identity/v3/projects/ebfb49c53afc43dab99fad98da6b3e94 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:13.551294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc591aac-d93d-4be7-b005-a66bb6f8c159 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:13.664668 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc591aac-d93d-4be7-b005-a66bb6f8c159 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:13.705496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef6fa1-d713-4f02-862f-da19756aa5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:13.706192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef6fa1-d713-4f02-862f-da19756aa5e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.706473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef6fa1-d713-4f02-862f-da19756aa5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.706743 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef6fa1-d713-4f02-862f-da19756aa5e1 None admin] PATH_INFO: `/v3/projects/ebfb49c53afc43dab99fad98da6b3e94/groups/4a429e47eb33488f999fd6d649de2bce/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:13.711324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef6fa1-d713-4f02-862f-da19756aa5e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebfb49c53afc43dab99fad98da6b3e94, group_id=4a429e47eb33488f999fd6d649de2bce, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:13.712770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef6fa1-d713-4f02-862f-da19756aa5e1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:13.776734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693d8ff-3cee-43a7-b587-2526824778dd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:13.809072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 203/417] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Oct 4 08:43:13 2022] PUT /identity/v3/projects/ebfb49c53afc43dab99fad98da6b3e94/groups/4a429e47eb33488f999fd6d649de2bce/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:13.899437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693d8ff-3cee-43a7-b587-2526824778dd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:13.939713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714401f-98f8-4867-aa55-f1209037fb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:13.940377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714401f-98f8-4867-aa55-f1209037fb4e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.940664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714401f-98f8-4867-aa55-f1209037fb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.940943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714401f-98f8-4867-aa55-f1209037fb4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:13.952531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714401f-98f8-4867-aa55-f1209037fb4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d714401f-98f8-4867-aa55-f1209037fb4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:13.957709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:13.958654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:13.959430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:13.964044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 215/418] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:13.965679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef6fa1-d713-4f02-862f-da19756aa5e1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:13.984825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8148-5c60-4d7f-94ed-03aa6490fe3a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.985466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8148-5c60-4d7f-94ed-03aa6490fe3a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.985935 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d8148-5c60-4d7f-94ed-03aa6490fe3a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:13.987761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 216/419] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:13.990385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:13.993525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58650dd1-e4d3-4dcf-9519-843ef1acca64 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:13.994058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58650dd1-e4d3-4dcf-9519-843ef1acca64 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:13.995142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58650dd1-e4d3-4dcf-9519-843ef1acca64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.014182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-58650dd1-e4d3-4dcf-9519-843ef1acca64 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:14.015740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-58650dd1-e4d3-4dcf-9519-843ef1acca64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:14.043212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:14.113566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 217/420] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:14.138591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef6fa1-d713-4f02-862f-da19756aa5e1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:14.175925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43fca2-1639-4c38-ba66-f435f32f1da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:14.176587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43fca2-1639-4c38-ba66-f435f32f1da7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:14.176865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43fca2-1639-4c38-ba66-f435f32f1da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:14.177172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43fca2-1639-4c38-ba66-f435f32f1da7 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.177841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43fca2-1639-4c38-ba66-f435f32f1da7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:14.178168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43fca2-1639-4c38-ba66-f435f32f1da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:14.179534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43fca2-1639-4c38-ba66-f435f32f1da7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:14.190057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 204/421] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:43:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:14.195894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58650dd1-e4d3-4dcf-9519-843ef1acca64 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:14.311835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58650dd1-e4d3-4dcf-9519-843ef1acca64 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:14.359286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f5da1-329c-4662-97ba-8fde457571fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:14.359907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f5da1-329c-4662-97ba-8fde457571fa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:14.360185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f5da1-329c-4662-97ba-8fde457571fa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:14.360456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f5da1-329c-4662-97ba-8fde457571fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.391091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:14.415023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43fca2-1639-4c38-ba66-f435f32f1da7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:14.453198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f5da1-329c-4662-97ba-8fde457571fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:14.454612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f5da1-329c-4662-97ba-8fde457571fa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:14.506484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:14.530681 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43fca2-1639-4c38-ba66-f435f32f1da7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:14.564862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f31a76-4ff9-4bc7-8e55-9ae96c379462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:14.565497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f31a76-4ff9-4bc7-8e55-9ae96c379462 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:14.565941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f31a76-4ff9-4bc7-8e55-9ae96c379462 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:14.566252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f31a76-4ff9-4bc7-8e55-9ae96c379462 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.578455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f31a76-4ff9-4bc7-8e55-9ae96c379462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-38f31a76-4ff9-4bc7-8e55-9ae96c379462 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:14.583556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:14.584439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:14.585819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 205/422] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:43:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:14.590958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f31a76-4ff9-4bc7-8e55-9ae96c379462 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:14.694836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f31a76-4ff9-4bc7-8e55-9ae96c379462 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:14.710524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 218/423] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:14.711735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f5da1-329c-4662-97ba-8fde457571fa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:14.728516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d61315-4c55-4d1f-9caa-887c4152322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:14.729645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d61315-4c55-4d1f-9caa-887c4152322d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:14.729923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d61315-4c55-4d1f-9caa-887c4152322d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:14.730259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d61315-4c55-4d1f-9caa-887c4152322d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.731301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d61315-4c55-4d1f-9caa-887c4152322d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:14.731608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d61315-4c55-4d1f-9caa-887c4152322d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:14.738240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d61315-4c55-4d1f-9caa-887c4152322d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:14.741904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 206/424] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:14.742525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:14.748208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d61315-4c55-4d1f-9caa-887c4152322d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:14.819060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:14.872356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d61315-4c55-4d1f-9caa-887c4152322d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:14.905685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f5da1-329c-4662-97ba-8fde457571fa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:14.906751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11957237-0980-46f3-9623-2ed81990247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:14.907439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11957237-0980-46f3-9623-2ed81990247e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:14.907789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11957237-0980-46f3-9623-2ed81990247e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:14.908222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11957237-0980-46f3-9623-2ed81990247e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.966074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a405620-462d-4082-b42a-35faca8ba4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:14.966823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a405620-462d-4082-b42a-35faca8ba4aa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:14.967350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a405620-462d-4082-b42a-35faca8ba4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:14.967667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a405620-462d-4082-b42a-35faca8ba4aa None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.968913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a405620-462d-4082-b42a-35faca8ba4aa None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:14.970612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a405620-462d-4082-b42a-35faca8ba4aa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:14.972457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 219/425] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:14 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:14.978325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4f3e1-5b08-4c47-b31c-04ce9768f13c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:14.979351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4f3e1-5b08-4c47-b31c-04ce9768f13c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:14.979730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4f3e1-5b08-4c47-b31c-04ce9768f13c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.981487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 220/426] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:14.982760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4f3e1-5b08-4c47-b31c-04ce9768f13c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:14.989766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:14.992395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11957237-0980-46f3-9623-2ed81990247e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:14.993938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11957237-0980-46f3-9623-2ed81990247e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:15.093881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4f3e1-5b08-4c47-b31c-04ce9768f13c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:15.104787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 207/427] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:15.106427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac9f0f-c660-4705-b673-e2a849535798 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.106996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac9f0f-c660-4705-b673-e2a849535798 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.107119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac9f0f-c660-4705-b673-e2a849535798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.120118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:15.126124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-75ac9f0f-c660-4705-b673-e2a849535798 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:15.127311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-75ac9f0f-c660-4705-b673-e2a849535798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:15.132723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c83d3f-f7a6-4170-bc0e-46b9877ff92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:15.133599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c83d3f-f7a6-4170-bc0e-46b9877ff92d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.134098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c83d3f-f7a6-4170-bc0e-46b9877ff92d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.134693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c83d3f-f7a6-4170-bc0e-46b9877ff92d None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.136694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c83d3f-f7a6-4170-bc0e-46b9877ff92d None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:15.138499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c83d3f-f7a6-4170-bc0e-46b9877ff92d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:15.140436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 221/428] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:14 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:15.142444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c83d3f-f7a6-4170-bc0e-46b9877ff92d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:15.201957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 208/429] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:15.202650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac9f0f-c660-4705-b673-e2a849535798 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:15.234537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:15.266399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c83d3f-f7a6-4170-bc0e-46b9877ff92d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:15.303462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a1e4-4003-4631-8d18-b385a36e2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:15.304408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a1e4-4003-4631-8d18-b385a36e2d69 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.304904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a1e4-4003-4631-8d18-b385a36e2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.305417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a1e4-4003-4631-8d18-b385a36e2d69 None admin] PATH_INFO: `/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.305824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac9f0f-c660-4705-b673-e2a849535798 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:15.307846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9a1e4-4003-4631-8d18-b385a36e2d69 None admin] RBAC: Authorizing `identity:get_project(project_id=8cef5622f4fc4c5d96c4ccb770698d16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:15.309657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9a1e4-4003-4631-8d18-b385a36e2d69 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:15.311973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 222/430] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:15 2022] GET /identity/v3/projects/8cef5622f4fc4c5d96c4ccb770698d16 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:15.321306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a1e4-4003-4631-8d18-b385a36e2d69 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:15.377810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026118-fa89-4f2b-8337-fc4f0c5eb263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:15.378811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026118-fa89-4f2b-8337-fc4f0c5eb263 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.379339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026118-fa89-4f2b-8337-fc4f0c5eb263 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.379811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026118-fa89-4f2b-8337-fc4f0c5eb263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.380813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80026118-fa89-4f2b-8337-fc4f0c5eb263 None admin] RBAC: Adding query filter params (group.id=52f27c81598045d0bd137c43f4794cef, role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:15.381341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80026118-fa89-4f2b-8337-fc4f0c5eb263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:15.384554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80026118-fa89-4f2b-8337-fc4f0c5eb263 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:15.402241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 209/431] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:15 2022] GET /identity/v3/role_assignments?group.id=52f27c81598045d0bd137c43f4794cef&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=522cad34ce354f77b50e5490fdb6174d => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:15.422501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:15.490443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a1e4-4003-4631-8d18-b385a36e2d69 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:15.522220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026118-fa89-4f2b-8337-fc4f0c5eb263 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:15.543140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eec1e8-c8b7-434c-85fb-c0c1319e8fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:15.544260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eec1e8-c8b7-434c-85fb-c0c1319e8fdb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.544891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eec1e8-c8b7-434c-85fb-c0c1319e8fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.545511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eec1e8-c8b7-434c-85fb-c0c1319e8fdb None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.547021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eec1e8-c8b7-434c-85fb-c0c1319e8fdb None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:15.548806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eec1e8-c8b7-434c-85fb-c0c1319e8fdb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:15.550708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 223/432] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:15 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:15.559234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eec1e8-c8b7-434c-85fb-c0c1319e8fdb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:15.635398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:15.641000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026118-fa89-4f2b-8337-fc4f0c5eb263 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:15.679435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403c3ad-96df-4e31-9fa0-e940ad9d353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:15.680070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c3ad-96df-4e31-9fa0-e940ad9d353c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.680348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c3ad-96df-4e31-9fa0-e940ad9d353c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.680618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e403c3ad-96df-4e31-9fa0-e940ad9d353c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.692493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e403c3ad-96df-4e31-9fa0-e940ad9d353c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e403c3ad-96df-4e31-9fa0-e940ad9d353c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:15.697599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:15.698727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:15.699959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 210/433] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:15.705357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403c3ad-96df-4e31-9fa0-e940ad9d353c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:15.729388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eec1e8-c8b7-434c-85fb-c0c1319e8fdb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:15.766662 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:15.777733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9572d-671e-447f-93a8-88debc8afac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:15.778712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9572d-671e-447f-93a8-88debc8afac9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.778998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9572d-671e-447f-93a8-88debc8afac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.779273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9572d-671e-447f-93a8-88debc8afac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.780448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9572d-671e-447f-93a8-88debc8afac9 None admin] RBAC: Adding query filter params (group.id=52f27c81598045d0bd137c43f4794cef, role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:15.782372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9572d-671e-447f-93a8-88debc8afac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:15.782372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9572d-671e-447f-93a8-88debc8afac9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:15.791501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 224/434] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:15 2022] GET /identity/v3/role_assignments?group.id=52f27c81598045d0bd137c43f4794cef&scope.project.id=8cef5622f4fc4c5d96c4ccb770698d16&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 611 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:15.835537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e403c3ad-96df-4e31-9fa0-e940ad9d353c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:15.876902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01783e5c-c8e0-4a8e-83da-96386cf17b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:15.877784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01783e5c-c8e0-4a8e-83da-96386cf17b46 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.878260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01783e5c-c8e0-4a8e-83da-96386cf17b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.878689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01783e5c-c8e0-4a8e-83da-96386cf17b46 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.879518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01783e5c-c8e0-4a8e-83da-96386cf17b46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:15.879963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01783e5c-c8e0-4a8e-83da-96386cf17b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:15.881593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01783e5c-c8e0-4a8e-83da-96386cf17b46 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:15.891499 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 211/435] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:43:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:15.896992 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9572d-671e-447f-93a8-88debc8afac9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:16.030906 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9572d-671e-447f-93a8-88debc8afac9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:16.070101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835474a7-cebf-499e-adc5-9bd8f8ff4171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:16.070952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835474a7-cebf-499e-adc5-9bd8f8ff4171 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:16.071394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835474a7-cebf-499e-adc5-9bd8f8ff4171 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:16.071806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835474a7-cebf-499e-adc5-9bd8f8ff4171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:16.136300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:16.149516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835474a7-cebf-499e-adc5-9bd8f8ff4171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:16.155967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835474a7-cebf-499e-adc5-9bd8f8ff4171 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:16.261651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 225/436] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:16.267088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01783e5c-c8e0-4a8e-83da-96386cf17b46 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:16.275652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068585b1-bbe7-4b09-924d-a0edf729bb23 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:16.275938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068585b1-bbe7-4b09-924d-a0edf729bb23 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:16.276217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068585b1-bbe7-4b09-924d-a0edf729bb23 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:16.277706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 226/437] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:43:16.282868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee87a30-40a8-4592-8375-96049450cb5a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:16.283106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee87a30-40a8-4592-8375-96049450cb5a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:16.283385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee87a30-40a8-4592-8375-96049450cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:16.290411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:16.303490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-aee87a30-40a8-4592-8375-96049450cb5a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:16.304712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aee87a30-40a8-4592-8375-96049450cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:16.387946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 227/438] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:16.398611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01783e5c-c8e0-4a8e-83da-96386cf17b46 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:16.432746 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7681-2a76-4128-93ee-4118354cea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:16.433617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7681-2a76-4128-93ee-4118354cea7f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:16.434060 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7681-2a76-4128-93ee-4118354cea7f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:16.434490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7681-2a76-4128-93ee-4118354cea7f None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:16.435844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da7681-2a76-4128-93ee-4118354cea7f None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:16.437413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da7681-2a76-4128-93ee-4118354cea7f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:16.439506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 212/439] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:16 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:16.445014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee87a30-40a8-4592-8375-96049450cb5a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:16.469730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:16.552258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee87a30-40a8-4592-8375-96049450cb5a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:16.586303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17becfd-09ef-46ba-9128-aaccd44be58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:16.586936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17becfd-09ef-46ba-9128-aaccd44be58c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:16.587218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17becfd-09ef-46ba-9128-aaccd44be58c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:16.587490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17becfd-09ef-46ba-9128-aaccd44be58c None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:16.588638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17becfd-09ef-46ba-9128-aaccd44be58c None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:16.590071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17becfd-09ef-46ba-9128-aaccd44be58c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:16.591838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 228/440] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:16 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:16.597399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7681-2a76-4128-93ee-4118354cea7f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:16.620753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3011d-4a9e-4025-b663-fc421cb627c4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:16.621045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3011d-4a9e-4025-b663-fc421cb627c4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:16.621320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3011d-4a9e-4025-b663-fc421cb627c4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:16.622667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 229/441] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:43:16.627383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017a47-ff6b-4d0a-84cc-6aaa659e9c5c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:16.627666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017a47-ff6b-4d0a-84cc-6aaa659e9c5c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:16.627940 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50017a47-ff6b-4d0a-84cc-6aaa659e9c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:16.645387 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-50017a47-ff6b-4d0a-84cc-6aaa659e9c5c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:16.646597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-50017a47-ff6b-4d0a-84cc-6aaa659e9c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:16.687358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:16.702160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7681-2a76-4128-93ee-4118354cea7f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:16.712286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 230/442] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:16.713262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50017a47-ff6b-4d0a-84cc-6aaa659e9c5c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:16.732520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:16.738500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e163b-e93d-4979-b235-5b3a7baf4fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:16.739109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e163b-e93d-4979-b235-5b3a7baf4fea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:16.742793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e163b-e93d-4979-b235-5b3a7baf4fea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:16.742793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e163b-e93d-4979-b235-5b3a7baf4fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:16.742793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e163b-e93d-4979-b235-5b3a7baf4fea None admin] RBAC: Adding query filter params (group.id=52f27c81598045d0bd137c43f4794cef, role.id=522cad34ce354f77b50e5490fdb6174d, scope.project.id=2128b23359fb4df3954335bb9c1edc4e) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:16.742793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e163b-e93d-4979-b235-5b3a7baf4fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:16.742793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e163b-e93d-4979-b235-5b3a7baf4fea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:16.748536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 213/443] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:16 2022] GET /identity/v3/role_assignments?group.id=52f27c81598045d0bd137c43f4794cef&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=522cad34ce354f77b50e5490fdb6174d => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:16.825270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50017a47-ff6b-4d0a-84cc-6aaa659e9c5c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:16.862352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25283-e221-40ff-b08c-3c837d0af72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:16.863268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25283-e221-40ff-b08c-3c837d0af72b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:16.863703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25283-e221-40ff-b08c-3c837d0af72b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:16.864261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25283-e221-40ff-b08c-3c837d0af72b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:16.876696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed25283-e221-40ff-b08c-3c837d0af72b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3ed25283-e221-40ff-b08c-3c837d0af72b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:16.881853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:16.882922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:16.883872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:16.885954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 231/444] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:43:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:16.892088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e163b-e93d-4979-b235-5b3a7baf4fea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:16.975846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25283-e221-40ff-b08c-3c837d0af72b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:17.006854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e163b-e93d-4979-b235-5b3a7baf4fea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.046696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf037-862c-4f46-9640-b1c420e86f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.047309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf037-862c-4f46-9640-b1c420e86f8d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.047585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf037-862c-4f46-9640-b1c420e86f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.047856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf037-862c-4f46-9640-b1c420e86f8d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.048529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdf037-862c-4f46-9640-b1c420e86f8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:17.048830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdf037-862c-4f46-9640-b1c420e86f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:17.050250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdf037-862c-4f46-9640-b1c420e86f8d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:17.058794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 214/445] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:17.065141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf037-862c-4f46-9640-b1c420e86f8d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:17.073584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:17.079452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:17.099513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25283-e221-40ff-b08c-3c837d0af72b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.138580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498653-ebaf-43dd-bfaa-4f295f3b6ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.139221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498653-ebaf-43dd-bfaa-4f295f3b6ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.139503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498653-ebaf-43dd-bfaa-4f295f3b6ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.139778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498653-ebaf-43dd-bfaa-4f295f3b6ea4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.149751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5498653-ebaf-43dd-bfaa-4f295f3b6ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f5498653-ebaf-43dd-bfaa-4f295f3b6ea4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:17.155176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:17.156094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:17.157163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 232/446] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:17.161913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498653-ebaf-43dd-bfaa-4f295f3b6ea4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:17.183415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf037-862c-4f46-9640-b1c420e86f8d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.216790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f19189-4e78-46e0-ba20-cfcdf50b9711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.217392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f19189-4e78-46e0-ba20-cfcdf50b9711 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.217733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f19189-4e78-46e0-ba20-cfcdf50b9711 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.218021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f19189-4e78-46e0-ba20-cfcdf50b9711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.261191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498653-ebaf-43dd-bfaa-4f295f3b6ea4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.285909 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f19189-4e78-46e0-ba20-cfcdf50b9711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:17.287394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f19189-4e78-46e0-ba20-cfcdf50b9711 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:17.294634 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ab3c4-0a79-4b9f-95b9-5aa207f5d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.295244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ab3c4-0a79-4b9f-95b9-5aa207f5d3ab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.295527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ab3c4-0a79-4b9f-95b9-5aa207f5d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.295800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ab3c4-0a79-4b9f-95b9-5aa207f5d3ab None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.296465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ab3c4-0a79-4b9f-95b9-5aa207f5d3ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:17.296775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ab3c4-0a79-4b9f-95b9-5aa207f5d3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:17.298168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ab3c4-0a79-4b9f-95b9-5aa207f5d3ab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:17.298690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:17.303107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:17.306536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 233/447] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:17.312640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ab3c4-0a79-4b9f-95b9-5aa207f5d3ab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:17.386941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 215/448] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:43:17.392574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f19189-4e78-46e0-ba20-cfcdf50b9711 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:17.409127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ab3c4-0a79-4b9f-95b9-5aa207f5d3ab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.441746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1de7-1506-438e-ab50-7298fc313afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.442377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1de7-1506-438e-ab50-7298fc313afa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.442661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1de7-1506-438e-ab50-7298fc313afa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.442934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1de7-1506-438e-ab50-7298fc313afa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.489089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f19189-4e78-46e0-ba20-cfcdf50b9711 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.499986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:17.506769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:17.508997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e1de7-1506-438e-ab50-7298fc313afa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:17.510995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e1de7-1506-438e-ab50-7298fc313afa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:17.523104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24ffef-994d-4084-873b-99d1fcd3858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.523738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24ffef-994d-4084-873b-99d1fcd3858d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.524017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24ffef-994d-4084-873b-99d1fcd3858d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.524289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24ffef-994d-4084-873b-99d1fcd3858d None admin] PATH_INFO: `/v3/projects/2128b23359fb4df3954335bb9c1edc4e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.526129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24ffef-994d-4084-873b-99d1fcd3858d None admin] RBAC: Authorizing `identity:get_project(project_id=2128b23359fb4df3954335bb9c1edc4e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:17.527574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24ffef-994d-4084-873b-99d1fcd3858d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:17.529181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 216/449] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:17 2022] GET /identity/v3/projects/2128b23359fb4df3954335bb9c1edc4e => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:17.534592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24ffef-994d-4084-873b-99d1fcd3858d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:17.605931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 234/450] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:43:17.611507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1de7-1506-438e-ab50-7298fc313afa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:17.630907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24ffef-994d-4084-873b-99d1fcd3858d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.668622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a950a4-20d4-4143-8c36-008cbe109bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.669164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a950a4-20d4-4143-8c36-008cbe109bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.669445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a950a4-20d4-4143-8c36-008cbe109bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.669800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a950a4-20d4-4143-8c36-008cbe109bf2 None admin] PATH_INFO: `/v3/groups/52f27c81598045d0bd137c43f4794cef` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.670951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a950a4-20d4-4143-8c36-008cbe109bf2 None admin] RBAC: Authorizing `identity:get_group(group_id=52f27c81598045d0bd137c43f4794cef)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:17.672398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a950a4-20d4-4143-8c36-008cbe109bf2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:17.673955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 217/451] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:17 2022] GET /identity/v3/groups/52f27c81598045d0bd137c43f4794cef => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:17.679672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a950a4-20d4-4143-8c36-008cbe109bf2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:17.706095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:17.708998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1de7-1506-438e-ab50-7298fc313afa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.725275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:17.742684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd514c3-a39f-41ba-af77-28f8e1c84b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.743308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd514c3-a39f-41ba-af77-28f8e1c84b99 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.743591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd514c3-a39f-41ba-af77-28f8e1c84b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.743867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd514c3-a39f-41ba-af77-28f8e1c84b99 None admin] PATH_INFO: `/v3/projects/ebfb49c53afc43dab99fad98da6b3e94` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.745584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd514c3-a39f-41ba-af77-28f8e1c84b99 None admin] RBAC: Authorizing `identity:get_project(project_id=ebfb49c53afc43dab99fad98da6b3e94)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:17.747063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd514c3-a39f-41ba-af77-28f8e1c84b99 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:17.748953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 235/452] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:43:17 2022] GET /identity/v3/projects/ebfb49c53afc43dab99fad98da6b3e94 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:17.754472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd514c3-a39f-41ba-af77-28f8e1c84b99 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:17.779849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a950a4-20d4-4143-8c36-008cbe109bf2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.813624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb24e2-c79a-45bd-a776-fd64eafe4dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.814257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb24e2-c79a-45bd-a776-fd64eafe4dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.814576 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb24e2-c79a-45bd-a776-fd64eafe4dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.814810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb24e2-c79a-45bd-a776-fd64eafe4dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.815535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb24e2-c79a-45bd-a776-fd64eafe4dc3 None admin] RBAC: Adding query filter params (group.id=52f27c81598045d0bd137c43f4794cef, role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=2128b23359fb4df3954335bb9c1edc4e) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:17.815843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb24e2-c79a-45bd-a776-fd64eafe4dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:17.817260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb24e2-c79a-45bd-a776-fd64eafe4dc3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:17.823497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 218/453] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:17 2022] GET /identity/v3/role_assignments?group.id=52f27c81598045d0bd137c43f4794cef&scope.project.id=2128b23359fb4df3954335bb9c1edc4e&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:17.854924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd514c3-a39f-41ba-af77-28f8e1c84b99 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:17.892170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c069f4-7462-4db2-92ec-e2503a5451a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:17.892810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c069f4-7462-4db2-92ec-e2503a5451a0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:17.893091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c069f4-7462-4db2-92ec-e2503a5451a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:17.893362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c069f4-7462-4db2-92ec-e2503a5451a0 None admin] PATH_INFO: `/v3/groups/4a429e47eb33488f999fd6d649de2bce` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:17.894561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c069f4-7462-4db2-92ec-e2503a5451a0 None admin] RBAC: Authorizing `identity:get_group(group_id=4a429e47eb33488f999fd6d649de2bce)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:17.896033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c069f4-7462-4db2-92ec-e2503a5451a0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:17.897671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 236/454] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Oct 4 08:43:17 2022] GET /identity/v3/groups/4a429e47eb33488f999fd6d649de2bce => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:17.903862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb24e2-c79a-45bd-a776-fd64eafe4dc3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:18.009685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb24e2-c79a-45bd-a776-fd64eafe4dc3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:18.020890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:18.044564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4060e-c99f-4b55-bce4-2c52e0c8c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:18.045167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4060e-c99f-4b55-bce4-2c52e0c8c76b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:18.045448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4060e-c99f-4b55-bce4-2c52e0c8c76b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:18.045729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4060e-c99f-4b55-bce4-2c52e0c8c76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:18.046490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4060e-c99f-4b55-bce4-2c52e0c8c76b None admin] RBAC: Adding query filter params (group.id=4a429e47eb33488f999fd6d649de2bce, role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=ebfb49c53afc43dab99fad98da6b3e94) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:18.046798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4060e-c99f-4b55-bce4-2c52e0c8c76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:18.048219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4060e-c99f-4b55-bce4-2c52e0c8c76b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:18.054051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 219/455] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Oct 4 08:43:17 2022] GET /identity/v3/role_assignments?group.id=4a429e47eb33488f999fd6d649de2bce&scope.project.id=ebfb49c53afc43dab99fad98da6b3e94&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:20.553627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48274643-89b6-4086-b48b-d66a674a8006 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:20.554159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48274643-89b6-4086-b48b-d66a674a8006 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:20.554235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48274643-89b6-4086-b48b-d66a674a8006 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:20.555555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 237/456] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:20.560779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61954dc-e337-42bd-b4c2-9c99dc4af54f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:20.561599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61954dc-e337-42bd-b4c2-9c99dc4af54f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:20.562076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61954dc-e337-42bd-b4c2-9c99dc4af54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:20.587067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a61954dc-e337-42bd-b4c2-9c99dc4af54f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:20.589159 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a61954dc-e337-42bd-b4c2-9c99dc4af54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:20.674330 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 220/457] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:20.734071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c67b7-bf12-4ff8-9a10-2de44ab7ac73 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:20.734713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c67b7-bf12-4ff8-9a10-2de44ab7ac73 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:20.735190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c67b7-bf12-4ff8-9a10-2de44ab7ac73 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:20.736979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 238/458] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:20.741935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e90963-69d2-4645-b94f-0d4c2164e66e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:20.742296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e90963-69d2-4645-b94f-0d4c2164e66e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:20.742582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e90963-69d2-4645-b94f-0d4c2164e66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:20.769789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-33e90963-69d2-4645-b94f-0d4c2164e66e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:20.771045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-33e90963-69d2-4645-b94f-0d4c2164e66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:20.862595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 221/459] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:21.015045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c67b7-bf12-4ff8-9a10-2de44ab7ac73 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:21.069277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:21.144319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c67b7-bf12-4ff8-9a10-2de44ab7ac73 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:21.179564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345049ba-0056-4e8e-b2c1-7ca273485c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:21.180200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345049ba-0056-4e8e-b2c1-7ca273485c27 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.180484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345049ba-0056-4e8e-b2c1-7ca273485c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.180758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345049ba-0056-4e8e-b2c1-7ca273485c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.191336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345049ba-0056-4e8e-b2c1-7ca273485c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:21.192801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345049ba-0056-4e8e-b2c1-7ca273485c27 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-345049ba-0056-4e8e-b2c1-7ca273485c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:21.208624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:21.209541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:21.210443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:21.210443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:21.210443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:21.210443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 239/460] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:21.216303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e90963-69d2-4645-b94f-0d4c2164e66e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:21.227002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345049ba-0056-4e8e-b2c1-7ca273485c27 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:21.302440 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:21.370238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:21.387768 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e90963-69d2-4645-b94f-0d4c2164e66e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:21.391987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345049ba-0056-4e8e-b2c1-7ca273485c27 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:21.427457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc78237-4e4b-41fb-a6f2-58ded8bad77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:21.427874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea195e00-f792-4001-b522-c74e662430ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:21.428372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc78237-4e4b-41fb-a6f2-58ded8bad77b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.428662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc78237-4e4b-41fb-a6f2-58ded8bad77b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.428938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc78237-4e4b-41fb-a6f2-58ded8bad77b None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.429102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea195e00-f792-4001-b522-c74e662430ef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.429522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea195e00-f792-4001-b522-c74e662430ef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.429627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc78237-4e4b-41fb-a6f2-58ded8bad77b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:21.429886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc78237-4e4b-41fb-a6f2-58ded8bad77b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:21.430198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea195e00-f792-4001-b522-c74e662430ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.431310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc78237-4e4b-41fb-a6f2-58ded8bad77b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:21.440804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea195e00-f792-4001-b522-c74e662430ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:21.442456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea195e00-f792-4001-b522-c74e662430ef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:21.452444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 222/461] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:21.454011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf7d9-35ef-4852-9df8-bd0ff68f50e9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.454460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf7d9-35ef-4852-9df8-bd0ff68f50e9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.454899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf7d9-35ef-4852-9df8-bd0ff68f50e9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.456645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 223/462] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:21.458251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf7d9-35ef-4852-9df8-bd0ff68f50e9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ea195e00-f792-4001-b522-c74e662430ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:21.464835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:21.465948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:21.466937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:21.466937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:21.466937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:21.470160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 240/463] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:21.471573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98856d-99d5-426e-924a-c987a2027f55 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.472172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98856d-99d5-426e-924a-c987a2027f55 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.472592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98856d-99d5-426e-924a-c987a2027f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.497984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fe98856d-99d5-426e-924a-c987a2027f55 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:21.499648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fe98856d-99d5-426e-924a-c987a2027f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:21.568698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:21.573191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 241/464] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:21.579935 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98856d-99d5-426e-924a-c987a2027f55 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:21.582886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf7d9-35ef-4852-9df8-bd0ff68f50e9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:21.636651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd5c4-f841-4a7d-89a6-9f66fb9e8b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:21.637501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd5c4-f841-4a7d-89a6-9f66fb9e8b6e None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.637927 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd5c4-f841-4a7d-89a6-9f66fb9e8b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.638379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd5c4-f841-4a7d-89a6-9f66fb9e8b6e None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.639237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cd5c4-f841-4a7d-89a6-9f66fb9e8b6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:21.640893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cd5c4-f841-4a7d-89a6-9f66fb9e8b6e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:21.666616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:21.698299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98856d-99d5-426e-924a-c987a2027f55 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:21.731696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8cd28-09bb-424a-b6c6-f6238b0972ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:21.732299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8cd28-09bb-424a-b6c6-f6238b0972ea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.732586 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8cd28-09bb-424a-b6c6-f6238b0972ea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.732867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8cd28-09bb-424a-b6c6-f6238b0972ea None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.733517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8cd28-09bb-424a-b6c6-f6238b0972ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:21.733825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8cd28-09bb-424a-b6c6-f6238b0972ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:21.735266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8cd28-09bb-424a-b6c6-f6238b0972ea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:21.749624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 242/465] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:21.750781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69446211-b6bf-4a76-b021-d57fa588d764 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.751059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69446211-b6bf-4a76-b021-d57fa588d764 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.751345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69446211-b6bf-4a76-b021-d57fa588d764 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.754984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 224/466] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:43:21 2022] POST /identity/v3/users => generated 246 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:43:21.760820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd5c4-f841-4a7d-89a6-9f66fb9e8b6e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:21.760958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 243/467] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:21.760958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa5b5-eaa1-4719-9574-e720efb41291 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.760958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa5b5-eaa1-4719-9574-e720efb41291 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.760958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9aa5b5-eaa1-4719-9574-e720efb41291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.779873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ad9aa5b5-eaa1-4719-9574-e720efb41291 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:21.781225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ad9aa5b5-eaa1-4719-9574-e720efb41291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:21.895306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd5c4-f841-4a7d-89a6-9f66fb9e8b6e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:21.895502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 244/468] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:21.896359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aa5b5-eaa1-4719-9574-e720efb41291 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:21.954529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574219e-4148-48e8-960b-84afb029948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:21.955074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574219e-4148-48e8-960b-84afb029948a None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.955359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574219e-4148-48e8-960b-84afb029948a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.955695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574219e-4148-48e8-960b-84afb029948a None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.956383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574219e-4148-48e8-960b-84afb029948a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:21.958040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574219e-4148-48e8-960b-84afb029948a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:22.001890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:22.047023 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9aa5b5-eaa1-4719-9574-e720efb41291 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:22.051963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 225/469] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:43:21 2022] POST /identity/v3/users => generated 248 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:43:22.085123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245d01d-a524-45e7-8a16-16e67e9ccce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:22.085829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245d01d-a524-45e7-8a16-16e67e9ccce4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:22.086142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245d01d-a524-45e7-8a16-16e67e9ccce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:22.086641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245d01d-a524-45e7-8a16-16e67e9ccce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:22.098964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245d01d-a524-45e7-8a16-16e67e9ccce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:22.100451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245d01d-a524-45e7-8a16-16e67e9ccce4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b245d01d-a524-45e7-8a16-16e67e9ccce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:22.117154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:22.118153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:22.119558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:22.119558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:22.119558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:22.119558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 245/470] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:22.125948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574219e-4148-48e8-960b-84afb029948a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:22.136523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:22.221356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245d01d-a524-45e7-8a16-16e67e9ccce4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:22.262354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574219e-4148-48e8-960b-84afb029948a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:22.300354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be7cf7-6285-49df-9f7f-80cb8d0e43f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:22.301134 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be7cf7-6285-49df-9f7f-80cb8d0e43f8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:22.301435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be7cf7-6285-49df-9f7f-80cb8d0e43f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:22.301716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be7cf7-6285-49df-9f7f-80cb8d0e43f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:22.302490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be7cf7-6285-49df-9f7f-80cb8d0e43f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:22.302818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be7cf7-6285-49df-9f7f-80cb8d0e43f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:22.304741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be7cf7-6285-49df-9f7f-80cb8d0e43f8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:22.319763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 226/471] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:22.321103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21a0f6-3b09-4f55-9007-9093d0921e67 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:22.321391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21a0f6-3b09-4f55-9007-9093d0921e67 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:22.321665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21a0f6-3b09-4f55-9007-9093d0921e67 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:22.323777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 227/472] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:22.326836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21a0f6-3b09-4f55-9007-9093d0921e67 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:22.359946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245d01d-a524-45e7-8a16-16e67e9ccce4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:22.374432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:22.404568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15cce7-5d1a-4850-8138-8603d730bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:22.405682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15cce7-5d1a-4850-8138-8603d730bdfd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:22.406194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15cce7-5d1a-4850-8138-8603d730bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:22.406702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15cce7-5d1a-4850-8138-8603d730bdfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:22.411951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:22.423102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15cce7-5d1a-4850-8138-8603d730bdfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:22.424686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15cce7-5d1a-4850-8138-8603d730bdfd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bf15cce7-5d1a-4850-8138-8603d730bdfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:22.444617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:22.445826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:22.446840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:22.446840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:22.446840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:22.448506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 246/473] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:22.450546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abbc1f-26c1-4981-9ca1-1ae645c15779 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:22.450905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abbc1f-26c1-4981-9ca1-1ae645c15779 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:22.451190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21a0f6-3b09-4f55-9007-9093d0921e67 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:22.451299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abbc1f-26c1-4981-9ca1-1ae645c15779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:22.475741 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b4abbc1f-26c1-4981-9ca1-1ae645c15779 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:22.477505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b4abbc1f-26c1-4981-9ca1-1ae645c15779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:22.497802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b365f0-b174-40c7-9315-16bef864ba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:22.498792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b365f0-b174-40c7-9315-16bef864ba64 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:22.499148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b365f0-b174-40c7-9315-16bef864ba64 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:22.499876 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b365f0-b174-40c7-9315-16bef864ba64 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:22.500614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b365f0-b174-40c7-9315-16bef864ba64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:22.502171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b365f0-b174-40c7-9315-16bef864ba64 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:22.556289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 247/474] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:22.557741 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abbc1f-26c1-4981-9ca1-1ae645c15779 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:22.666624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:22.674101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 228/475] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:43:22 2022] POST /identity/v3/users => generated 248 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:43:22.684890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abbc1f-26c1-4981-9ca1-1ae645c15779 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:22.733280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372944c6-a837-4c52-b4c2-eb4001cd96a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:22.733823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372944c6-a837-4c52-b4c2-eb4001cd96a6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:22.734136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372944c6-a837-4c52-b4c2-eb4001cd96a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:22.734413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372944c6-a837-4c52-b4c2-eb4001cd96a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:22.735068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372944c6-a837-4c52-b4c2-eb4001cd96a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:22.735370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372944c6-a837-4c52-b4c2-eb4001cd96a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:22.736748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372944c6-a837-4c52-b4c2-eb4001cd96a6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:22.753452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 248/476] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:22.759307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b365f0-b174-40c7-9315-16bef864ba64 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:22.886499 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b365f0-b174-40c7-9315-16bef864ba64 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:22.911849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:22.922849 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372944c6-a837-4c52-b4c2-eb4001cd96a6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:22.925341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a69d0-451e-46c9-a256-db0f1812d7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:22.925996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a69d0-451e-46c9-a256-db0f1812d7fd None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:22.926313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a69d0-451e-46c9-a256-db0f1812d7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:22.926611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a69d0-451e-46c9-a256-db0f1812d7fd None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:22.927264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a69d0-451e-46c9-a256-db0f1812d7fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:22.928724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a69d0-451e-46c9-a256-db0f1812d7fd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:23.022740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 229/477] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:43:22 2022] POST /identity/v3/users => generated 249 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:43:23.060717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372944c6-a837-4c52-b4c2-eb4001cd96a6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:23.099931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:23.100550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:23.100828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:23.101097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:23.101785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:23.103365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:23.155614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:43:23.155614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 08:43:23.155614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [parameters: {'id': '2185cbea117b49539c8ee99f0473cd00', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 08:43:23.155614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Oct 04 08:43:23.172907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:43:23.173888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:43:23.174840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:43:23.175732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:43:23.176610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:43:23.177454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'id': '2185cbea117b49539c8ee99f0473cd00', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:23.179731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 08:43:23.181923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:23.183987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 249/478] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 08:43:22 2022] POST /identity/v3/roles => generated 144 bytes in 252 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:23.190137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a69d0-451e-46c9-a256-db0f1812d7fd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:23.321609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a69d0-451e-46c9-a256-db0f1812d7fd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:23.357475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971dc12-d99e-4fac-8ec4-205d533e65ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:23.358475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971dc12-d99e-4fac-8ec4-205d533e65ea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:23.358949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971dc12-d99e-4fac-8ec4-205d533e65ea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:23.359413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971dc12-d99e-4fac-8ec4-205d533e65ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:23.370351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971dc12-d99e-4fac-8ec4-205d533e65ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6971dc12-d99e-4fac-8ec4-205d533e65ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:23.376017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:23.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:43:23.377715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:23.380290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 230/479] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:43:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:23.386862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:23.414015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:23.504431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ffc24-b0ac-4f2c-b799-03ab32a3cbfa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:23.542054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3eb77-93be-4638-80cb-35d41b66ccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:23.542944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3eb77-93be-4638-80cb-35d41b66ccdb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:23.543369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3eb77-93be-4638-80cb-35d41b66ccdb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:23.543784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3eb77-93be-4638-80cb-35d41b66ccdb None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:23.544596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3eb77-93be-4638-80cb-35d41b66ccdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:23.545068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3eb77-93be-4638-80cb-35d41b66ccdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:23.546633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3eb77-93be-4638-80cb-35d41b66ccdb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:23.555442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 250/480] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:24.539486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a599e0-e7ac-430c-82c2-3eb3039986e5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:24.540049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a599e0-e7ac-430c-82c2-3eb3039986e5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:24.540049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a599e0-e7ac-430c-82c2-3eb3039986e5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:24.541739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 231/481] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:24.547613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32140d4d-6257-46be-b613-ec8da0f86922 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:24.548062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32140d4d-6257-46be-b613-ec8da0f86922 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:24.548245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32140d4d-6257-46be-b613-ec8da0f86922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:24.567133 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-32140d4d-6257-46be-b613-ec8da0f86922 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:24.568317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32140d4d-6257-46be-b613-ec8da0f86922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:24.644602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 251/482] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:24.650892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ff82a-8510-44e5-a02a-349f68af1477 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:24.651178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ff82a-8510-44e5-a02a-349f68af1477 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:24.651454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ff82a-8510-44e5-a02a-349f68af1477 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:24.652763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 232/483] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:24.657831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea34d6c-abef-4e7e-a68e-46e56e4a4228 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:24.658146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea34d6c-abef-4e7e-a68e-46e56e4a4228 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:24.658427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea34d6c-abef-4e7e-a68e-46e56e4a4228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:24.682135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2ea34d6c-abef-4e7e-a68e-46e56e4a4228 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:24.683307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2ea34d6c-abef-4e7e-a68e-46e56e4a4228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:24.686108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:24.760288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 252/484] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:24.980653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ff82a-8510-44e5-a02a-349f68af1477 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:25.030308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:25.111172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ff82a-8510-44e5-a02a-349f68af1477 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:25.157745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a50f0-6a32-4ee8-8078-b7989594a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:25.158409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a50f0-6a32-4ee8-8078-b7989594a0ac None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.158687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a50f0-6a32-4ee8-8078-b7989594a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.158956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a50f0-6a32-4ee8-8078-b7989594a0ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.160778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea34d6c-abef-4e7e-a68e-46e56e4a4228 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:25.171194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a50f0-6a32-4ee8-8078-b7989594a0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-317a50f0-6a32-4ee8-8078-b7989594a0ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:25.176504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:25.177380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:25.178578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 233/485] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:25.185017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a50f0-6a32-4ee8-8078-b7989594a0ac None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:25.308747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea34d6c-abef-4e7e-a68e-46e56e4a4228 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:25.364116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42135d5-1163-45b1-9c97-1cb805f27f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:25.364843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42135d5-1163-45b1-9c97-1cb805f27f1a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.365128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42135d5-1163-45b1-9c97-1cb805f27f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.365403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42135d5-1163-45b1-9c97-1cb805f27f1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.378912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:25.382037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42135d5-1163-45b1-9c97-1cb805f27f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:25.390589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a50f0-6a32-4ee8-8078-b7989594a0ac None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b42135d5-1163-45b1-9c97-1cb805f27f1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:25.396948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:25.397826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:25.399060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 253/486] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:25.399947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:25.404642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42135d5-1163-45b1-9c97-1cb805f27f1a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:25.447674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dd693-1b43-4b70-8a4e-8836ace29a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:25.448292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dd693-1b43-4b70-8a4e-8836ace29a5f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.448581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dd693-1b43-4b70-8a4e-8836ace29a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.448859 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dd693-1b43-4b70-8a4e-8836ace29a5f None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.449540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dd693-1b43-4b70-8a4e-8836ace29a5f None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:25.449848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dd693-1b43-4b70-8a4e-8836ace29a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:25.451296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dd693-1b43-4b70-8a4e-8836ace29a5f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:25.470880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 234/487] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:25.476581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451bf28-8627-442f-830a-37236dd81fb0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.476581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451bf28-8627-442f-830a-37236dd81fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.476581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451bf28-8627-442f-830a-37236dd81fb0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.478720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 235/488] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:25.479586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451bf28-8627-442f-830a-37236dd81fb0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:25.519258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42135d5-1163-45b1-9c97-1cb805f27f1a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:25.556320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16986e34-45bb-4859-9b74-308d25d326cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:25.557622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986e34-45bb-4859-9b74-308d25d326cc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.558098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986e34-45bb-4859-9b74-308d25d326cc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.558516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986e34-45bb-4859-9b74-308d25d326cc None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.559375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16986e34-45bb-4859-9b74-308d25d326cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:25.559817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16986e34-45bb-4859-9b74-308d25d326cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:25.561332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16986e34-45bb-4859-9b74-308d25d326cc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:25.578611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 254/489] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:25.580343 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a3ff3-9dfd-4517-97aa-ce89ef9ba043 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.580826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a3ff3-9dfd-4517-97aa-ce89ef9ba043 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.581298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a3ff3-9dfd-4517-97aa-ce89ef9ba043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.609014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b64a3ff3-9dfd-4517-97aa-ce89ef9ba043 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:25.611494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b64a3ff3-9dfd-4517-97aa-ce89ef9ba043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:25.655532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451bf28-8627-442f-830a-37236dd81fb0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:25.713863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7fd9e-3e54-44b0-91b4-89d56f97d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:25.714907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7fd9e-3e54-44b0-91b4-89d56f97d66d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.715423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7fd9e-3e54-44b0-91b4-89d56f97d66d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.715884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7fd9e-3e54-44b0-91b4-89d56f97d66d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.723487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:25.727363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7fd9e-3e54-44b0-91b4-89d56f97d66d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:25.729659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7fd9e-3e54-44b0-91b4-89d56f97d66d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-14e7fd9e-3e54-44b0-91b4-89d56f97d66d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:25.746277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:25.747177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:25.748021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:25.748021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:25.748021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:25.749871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 236/490] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:25.755238 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7fd9e-3e54-44b0-91b4-89d56f97d66d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:25.755360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 255/491] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:25.759960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a3ff3-9dfd-4517-97aa-ce89ef9ba043 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:25.800787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:25.910023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7fd9e-3e54-44b0-91b4-89d56f97d66d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:25.957995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06148ef-1559-448d-b204-4d4bed868cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:25.959019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06148ef-1559-448d-b204-4d4bed868cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.959549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06148ef-1559-448d-b204-4d4bed868cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.960013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06148ef-1559-448d-b204-4d4bed868cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.973091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06148ef-1559-448d-b204-4d4bed868cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:25.974912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06148ef-1559-448d-b204-4d4bed868cf4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d06148ef-1559-448d-b204-4d4bed868cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:25.990770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:25.991688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:25.992551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:25.992551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:25.992551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:25.995366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 237/492] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:26.000581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae37b3-0a06-4875-99eb-ee0deee9c9e7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.000581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae37b3-0a06-4875-99eb-ee0deee9c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.000786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae37b3-0a06-4875-99eb-ee0deee9c9e7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.002211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 238/493] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:26.005363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a3ff3-9dfd-4517-97aa-ce89ef9ba043 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.007838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae37b3-0a06-4875-99eb-ee0deee9c9e7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:26.047755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82b21-da1a-479d-a4de-1495c7d4b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.048402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82b21-da1a-479d-a4de-1495c7d4b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.048685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82b21-da1a-479d-a4de-1495c7d4b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.048960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82b21-da1a-479d-a4de-1495c7d4b3b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.049611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82b21-da1a-479d-a4de-1495c7d4b3b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:26.049905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82b21-da1a-479d-a4de-1495c7d4b3b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:26.051316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82b21-da1a-479d-a4de-1495c7d4b3b7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:26.068220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 256/494] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:26.068220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943b28-d81c-41d2-aafc-caaf0a506c48 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.068220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943b28-d81c-41d2-aafc-caaf0a506c48 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.068220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943b28-d81c-41d2-aafc-caaf0a506c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.085158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-83943b28-d81c-41d2-aafc-caaf0a506c48 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:26.086394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-83943b28-d81c-41d2-aafc-caaf0a506c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:26.136649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:26.149456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:26.162682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 257/495] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:26.163937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943b28-d81c-41d2-aafc-caaf0a506c48 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:26.220027 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae37b3-0a06-4875-99eb-ee0deee9c9e7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.273068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b434b8e-a7d6-49e2-81a3-e1a3bd76a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.273680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b434b8e-a7d6-49e2-81a3-e1a3bd76a7ed None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.273957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b434b8e-a7d6-49e2-81a3-e1a3bd76a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.274396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b434b8e-a7d6-49e2-81a3-e1a3bd76a7ed None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.274993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b434b8e-a7d6-49e2-81a3-e1a3bd76a7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:26.275786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b434b8e-a7d6-49e2-81a3-e1a3bd76a7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:26.277158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b434b8e-a7d6-49e2-81a3-e1a3bd76a7ed None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:26.296272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 239/496] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:26.298209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b434b8e-a7d6-49e2-81a3-e1a3bd76a7ed None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:26.337018 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943b28-d81c-41d2-aafc-caaf0a506c48 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.376433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9a04b-823d-4243-abc5-5fd517ca1c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.377071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9a04b-823d-4243-abc5-5fd517ca1c5c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.377371 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9a04b-823d-4243-abc5-5fd517ca1c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.377642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9a04b-823d-4243-abc5-5fd517ca1c5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.385432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9a04b-823d-4243-abc5-5fd517ca1c5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:26.387041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9a04b-823d-4243-abc5-5fd517ca1c5c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a0b9a04b-823d-4243-abc5-5fd517ca1c5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:26.401421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:26.402380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:26.403256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 258/497] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 08:43:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:26.403801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9a04b-823d-4243-abc5-5fd517ca1c5c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:26.423647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b434b8e-a7d6-49e2-81a3-e1a3bd76a7ed None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.451560 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:26.452584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:26.462053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965310c-2009-4dfe-9ed6-005c37d92f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.463313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965310c-2009-4dfe-9ed6-005c37d92f97 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.463592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965310c-2009-4dfe-9ed6-005c37d92f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.463863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965310c-2009-4dfe-9ed6-005c37d92f97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.473664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965310c-2009-4dfe-9ed6-005c37d92f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e965310c-2009-4dfe-9ed6-005c37d92f97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:26.478516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:26.479368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 240/498] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:26.488311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965310c-2009-4dfe-9ed6-005c37d92f97 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:26.508669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9a04b-823d-4243-abc5-5fd517ca1c5c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.541775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51aecd-7198-4a9c-817d-e4cc4a396ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.542433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51aecd-7198-4a9c-817d-e4cc4a396ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.542712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51aecd-7198-4a9c-817d-e4cc4a396ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.542992 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51aecd-7198-4a9c-817d-e4cc4a396ee8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.550070 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51aecd-7198-4a9c-817d-e4cc4a396ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:26.551560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51aecd-7198-4a9c-817d-e4cc4a396ee8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0c51aecd-7198-4a9c-817d-e4cc4a396ee8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:26.562400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:26.563697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 259/499] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:26.564577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51aecd-7198-4a9c-817d-e4cc4a396ee8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:26.586212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965310c-2009-4dfe-9ed6-005c37d92f97 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.619659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9f424-dc8a-4975-ad6e-c5f0cd735fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.620260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9f424-dc8a-4975-ad6e-c5f0cd735fdf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.620546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9f424-dc8a-4975-ad6e-c5f0cd735fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.620828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9f424-dc8a-4975-ad6e-c5f0cd735fdf None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.621562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9f424-dc8a-4975-ad6e-c5f0cd735fdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:26.621877 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9f424-dc8a-4975-ad6e-c5f0cd735fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:26.623357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9f424-dc8a-4975-ad6e-c5f0cd735fdf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:26.660405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 241/500] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 08:43:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:26.661403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff778a-ada4-4e73-b2b2-6b5b85464b7f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.661695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff778a-ada4-4e73-b2b2-6b5b85464b7f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.661972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff778a-ada4-4e73-b2b2-6b5b85464b7f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.663129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51aecd-7198-4a9c-817d-e4cc4a396ee8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.665432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:26.667385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 242/501] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:26.668182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff778a-ada4-4e73-b2b2-6b5b85464b7f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:26.696085 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba13bb3-69d6-4153-b6b3-7380476446b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.696646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13bb3-69d6-4153-b6b3-7380476446b0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.697457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13bb3-69d6-4153-b6b3-7380476446b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.697716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13bb3-69d6-4153-b6b3-7380476446b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.707976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba13bb3-69d6-4153-b6b3-7380476446b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:26.711645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4ba13bb3-69d6-4153-b6b3-7380476446b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:26.713287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:26.714223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:26.714999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 260/502] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:26.715647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba13bb3-69d6-4153-b6b3-7380476446b0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:26.772665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff778a-ada4-4e73-b2b2-6b5b85464b7f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.805377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25799e92-88a3-4fef-9229-e7188f1e629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.805974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25799e92-88a3-4fef-9229-e7188f1e629f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.806303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25799e92-88a3-4fef-9229-e7188f1e629f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.806572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25799e92-88a3-4fef-9229-e7188f1e629f None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.807228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25799e92-88a3-4fef-9229-e7188f1e629f None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:26.807528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25799e92-88a3-4fef-9229-e7188f1e629f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:26.808895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25799e92-88a3-4fef-9229-e7188f1e629f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:26.816339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 243/503] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:26.817106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25799e92-88a3-4fef-9229-e7188f1e629f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:26.850218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba13bb3-69d6-4153-b6b3-7380476446b0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.882952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c31c2-82a8-41c0-ba71-d81475386ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.883550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c31c2-82a8-41c0-ba71-d81475386ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.883823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c31c2-82a8-41c0-ba71-d81475386ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.884093 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c31c2-82a8-41c0-ba71-d81475386ff3 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.884845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c31c2-82a8-41c0-ba71-d81475386ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:26.885147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c31c2-82a8-41c0-ba71-d81475386ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:26.886621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c31c2-82a8-41c0-ba71-d81475386ff3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:26.912783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25799e92-88a3-4fef-9229-e7188f1e629f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:26.914991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:26.923474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 261/504] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 08:43:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:26.925026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5e522-b349-48c3-bde2-be4174becba6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.925317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5e522-b349-48c3-bde2-be4174becba6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.925591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5e522-b349-48c3-bde2-be4174becba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.944178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bfc5e522-b349-48c3-bde2-be4174becba6 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:26.945386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bfc5e522-b349-48c3-bde2-be4174becba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:26.949349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714c1a0-afc6-4ca6-8b73-d4828a0182a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:26.949893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714c1a0-afc6-4ca6-8b73-d4828a0182a6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:26.950200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714c1a0-afc6-4ca6-8b73-d4828a0182a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:26.950472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714c1a0-afc6-4ca6-8b73-d4828a0182a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:26.959478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:27.012403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 262/505] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:27.013314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5e522-b349-48c3-bde2-be4174becba6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.017296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714c1a0-afc6-4ca6-8b73-d4828a0182a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.018805 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714c1a0-afc6-4ca6-8b73-d4828a0182a6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.118467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5e522-b349-48c3-bde2-be4174becba6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.122043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 244/506] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:27.122784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714c1a0-afc6-4ca6-8b73-d4828a0182a6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.131226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:27.158363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97272d-1a9b-4017-b3b8-5ad42a4cffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.158967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97272d-1a9b-4017-b3b8-5ad42a4cffbc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.159259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97272d-1a9b-4017-b3b8-5ad42a4cffbc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.159522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97272d-1a9b-4017-b3b8-5ad42a4cffbc None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.160197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97272d-1a9b-4017-b3b8-5ad42a4cffbc None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:27.160507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97272d-1a9b-4017-b3b8-5ad42a4cffbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.161962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97272d-1a9b-4017-b3b8-5ad42a4cffbc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.174792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 263/507] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:27.174792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97272d-1a9b-4017-b3b8-5ad42a4cffbc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.186219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:27.236315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714c1a0-afc6-4ca6-8b73-d4828a0182a6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.271396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97272d-1a9b-4017-b3b8-5ad42a4cffbc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.273125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224694-426d-4ab9-8033-1f49f951158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.273756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224694-426d-4ab9-8033-1f49f951158b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.274037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224694-426d-4ab9-8033-1f49f951158b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.274344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224694-426d-4ab9-8033-1f49f951158b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.284848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63224694-426d-4ab9-8033-1f49f951158b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.286334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63224694-426d-4ab9-8033-1f49f951158b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-63224694-426d-4ab9-8033-1f49f951158b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:27.300525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:27.301431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:27.302371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:27.302371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.302371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:27.302371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 245/508] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:27.302631 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224694-426d-4ab9-8033-1f49f951158b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.310441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3cdcf-f06d-4d47-8c33-a5129b25be93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.311052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3cdcf-f06d-4d47-8c33-a5129b25be93 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.311346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3cdcf-f06d-4d47-8c33-a5129b25be93 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.312025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3cdcf-f06d-4d47-8c33-a5129b25be93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.357305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:27.379393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3cdcf-f06d-4d47-8c33-a5129b25be93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.380862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3cdcf-f06d-4d47-8c33-a5129b25be93 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.394530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:27.399765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224694-426d-4ab9-8033-1f49f951158b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.432453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7494114-ef4c-4fc5-8a71-ad16382dcb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.433069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7494114-ef4c-4fc5-8a71-ad16382dcb55 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.433352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7494114-ef4c-4fc5-8a71-ad16382dcb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.433628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7494114-ef4c-4fc5-8a71-ad16382dcb55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.443617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7494114-ef4c-4fc5-8a71-ad16382dcb55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.445061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7494114-ef4c-4fc5-8a71-ad16382dcb55 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f7494114-ef4c-4fc5-8a71-ad16382dcb55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:27.459222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:27.460094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:27.460958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:27.460958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.460958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:27.460958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 246/509] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:27.461167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7494114-ef4c-4fc5-8a71-ad16382dcb55 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.482986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 264/510] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:27.483827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3cdcf-f06d-4d47-8c33-a5129b25be93 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.558840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7494114-ef4c-4fc5-8a71-ad16382dcb55 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.567369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:27.580498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3cdcf-f06d-4d47-8c33-a5129b25be93 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.591472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876d48d-34ff-4b54-84ca-1f7d78b058fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.592100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876d48d-34ff-4b54-84ca-1f7d78b058fd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.592384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876d48d-34ff-4b54-84ca-1f7d78b058fd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.592664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876d48d-34ff-4b54-84ca-1f7d78b058fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.594305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:27.603792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876d48d-34ff-4b54-84ca-1f7d78b058fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.605581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876d48d-34ff-4b54-84ca-1f7d78b058fd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.615108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef444272-477e-4f5f-92e2-552a06b98322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.615726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef444272-477e-4f5f-92e2-552a06b98322 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.616005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef444272-477e-4f5f-92e2-552a06b98322 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.616280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef444272-477e-4f5f-92e2-552a06b98322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f876d48d-34ff-4b54-84ca-1f7d78b058fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:27.619980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:27.620826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:27.621675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:27.621675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.621675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:27.621675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 247/511] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:27.621883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876d48d-34ff-4b54-84ca-1f7d78b058fd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.626841 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef444272-477e-4f5f-92e2-552a06b98322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.628358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef444272-477e-4f5f-92e2-552a06b98322 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ef444272-477e-4f5f-92e2-552a06b98322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:27.643567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:27.644479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:27.645348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:27.645348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.645348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:27.645348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 265/512] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:27.645568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef444272-477e-4f5f-92e2-552a06b98322 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.719804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876d48d-34ff-4b54-84ca-1f7d78b058fd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.743121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef444272-477e-4f5f-92e2-552a06b98322 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.753992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004d85-415b-48ce-bf04-0da86eafee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.754629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004d85-415b-48ce-bf04-0da86eafee80 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.754941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004d85-415b-48ce-bf04-0da86eafee80 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.755219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004d85-415b-48ce-bf04-0da86eafee80 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.755875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004d85-415b-48ce-bf04-0da86eafee80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:27.756179 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004d85-415b-48ce-bf04-0da86eafee80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.757554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004d85-415b-48ce-bf04-0da86eafee80 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.769733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 248/513] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:27.770559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004d85-415b-48ce-bf04-0da86eafee80 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.780022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e7f49-5eaa-4139-9ca5-f6a193abc647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.780631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e7f49-5eaa-4139-9ca5-f6a193abc647 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.780910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e7f49-5eaa-4139-9ca5-f6a193abc647 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.781183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e7f49-5eaa-4139-9ca5-f6a193abc647 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.781825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e7f49-5eaa-4139-9ca5-f6a193abc647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:27.782151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e7f49-5eaa-4139-9ca5-f6a193abc647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.783595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e7f49-5eaa-4139-9ca5-f6a193abc647 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.790964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:27.795493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 266/514] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:27.796309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e7f49-5eaa-4139-9ca5-f6a193abc647 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.822926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:27.871044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004d85-415b-48ce-bf04-0da86eafee80 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.896770 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e7f49-5eaa-4139-9ca5-f6a193abc647 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:27.903510 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e40d33-7413-49d3-9cd0-af02e7cbc9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.904140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40d33-7413-49d3-9cd0-af02e7cbc9ea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.904421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40d33-7413-49d3-9cd0-af02e7cbc9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.904698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40d33-7413-49d3-9cd0-af02e7cbc9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.914687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e40d33-7413-49d3-9cd0-af02e7cbc9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.917070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e40d33-7413-49d3-9cd0-af02e7cbc9ea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.929807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa247e42-7db0-495a-938c-f1f75d9cfcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:27.930451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa247e42-7db0-495a-938c-f1f75d9cfcea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:27.930737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa247e42-7db0-495a-938c-f1f75d9cfcea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:27.931013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa247e42-7db0-495a-938c-f1f75d9cfcea None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-67e40d33-7413-49d3-9cd0-af02e7cbc9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:27.931833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:27.932706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:27.934206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:27.934206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:27.934206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:27.934383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa247e42-7db0-495a-938c-f1f75d9cfcea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:27.934383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa247e42-7db0-495a-938c-f1f75d9cfcea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:27.934516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 249/515] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:27.934584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa247e42-7db0-495a-938c-f1f75d9cfcea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:27.934648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e40d33-7413-49d3-9cd0-af02e7cbc9ea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:27.945696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 267/516] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:27.946383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa247e42-7db0-495a-938c-f1f75d9cfcea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.007265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:28.029779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:28.035853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e40d33-7413-49d3-9cd0-af02e7cbc9ea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.045703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa247e42-7db0-495a-938c-f1f75d9cfcea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.069597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe08b7-ff06-4641-a8d3-6b32af21b209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.070239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe08b7-ff06-4641-a8d3-6b32af21b209 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.070522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe08b7-ff06-4641-a8d3-6b32af21b209 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.070797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe08b7-ff06-4641-a8d3-6b32af21b209 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.071446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe08b7-ff06-4641-a8d3-6b32af21b209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:28.071779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe08b7-ff06-4641-a8d3-6b32af21b209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.073209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe08b7-ff06-4641-a8d3-6b32af21b209 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.079168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad1771-69e9-47be-98c9-f6a905a67779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.079795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad1771-69e9-47be-98c9-f6a905a67779 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.080073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad1771-69e9-47be-98c9-f6a905a67779 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.080344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad1771-69e9-47be-98c9-f6a905a67779 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.084630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 250/517] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:28.085416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe08b7-ff06-4641-a8d3-6b32af21b209 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.087220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad1771-69e9-47be-98c9-f6a905a67779 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.088712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad1771-69e9-47be-98c9-f6a905a67779 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-58ad1771-69e9-47be-98c9-f6a905a67779 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:28.100302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:28.101177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 268/518] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:28.102700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad1771-69e9-47be-98c9-f6a905a67779 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.185861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe08b7-ff06-4641-a8d3-6b32af21b209 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.200480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad1771-69e9-47be-98c9-f6a905a67779 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.213957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:28.218727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a2b39-ab9b-4d81-92f3-f514b504c99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.219350 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a2b39-ab9b-4d81-92f3-f514b504c99f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.219647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a2b39-ab9b-4d81-92f3-f514b504c99f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.219925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a2b39-ab9b-4d81-92f3-f514b504c99f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.226681 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a2b39-ab9b-4d81-92f3-f514b504c99f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.228614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a2b39-ab9b-4d81-92f3-f514b504c99f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.233597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d65527-ff99-4daf-a54e-961e06b53226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.234252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65527-ff99-4daf-a54e-961e06b53226 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.234538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65527-ff99-4daf-a54e-961e06b53226 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.234817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65527-ff99-4daf-a54e-961e06b53226 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.235467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d65527-ff99-4daf-a54e-961e06b53226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:28.235773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d65527-ff99-4daf-a54e-961e06b53226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.237143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d65527-ff99-4daf-a54e-961e06b53226 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b60a2b39-ab9b-4d81-92f3-f514b504c99f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:28.240449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:28.241328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:28.242205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:28.242205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:28.242205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:28.242205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:28.242205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:28.242205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:28.242205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:28.242205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:28.242205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 251/519] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:28.242670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a2b39-ab9b-4d81-92f3-f514b504c99f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.251754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 269/520] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:28.254949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d65527-ff99-4daf-a54e-961e06b53226 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.258389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:28.341815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a2b39-ab9b-4d81-92f3-f514b504c99f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.352755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d65527-ff99-4daf-a54e-961e06b53226 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.374320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabb3b0-04be-41e5-b5cb-9029edb8bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.374949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabb3b0-04be-41e5-b5cb-9029edb8bcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.375230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabb3b0-04be-41e5-b5cb-9029edb8bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.375505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabb3b0-04be-41e5-b5cb-9029edb8bcb6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.382737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabb3b0-04be-41e5-b5cb-9029edb8bcb6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.384319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabb3b0-04be-41e5-b5cb-9029edb8bcb6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.386323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de511909-440d-4f95-a960-6f03ffefb54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.386920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de511909-440d-4f95-a960-6f03ffefb54f None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.387201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de511909-440d-4f95-a960-6f03ffefb54f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.387476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de511909-440d-4f95-a960-6f03ffefb54f None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.388114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de511909-440d-4f95-a960-6f03ffefb54f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.389520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de511909-440d-4f95-a960-6f03ffefb54f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ebabb3b0-04be-41e5-b5cb-9029edb8bcb6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:28.397275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:28.398326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 252/521] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:28.399207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabb3b0-04be-41e5-b5cb-9029edb8bcb6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.450443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:28.457515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 270/522] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:43:28 2022] POST /identity/v3/users => generated 247 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:43:28.458373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de511909-440d-4f95-a960-6f03ffefb54f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.501726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabb3b0-04be-41e5-b5cb-9029edb8bcb6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.535909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:28.540650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9b239-eae5-4722-9ff9-feda0e3b5a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.541352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9b239-eae5-4722-9ff9-feda0e3b5a4b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.541637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9b239-eae5-4722-9ff9-feda0e3b5a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.541910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9b239-eae5-4722-9ff9-feda0e3b5a4b None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.542810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9b239-eae5-4722-9ff9-feda0e3b5a4b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:28.542992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9b239-eae5-4722-9ff9-feda0e3b5a4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.544576 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9b239-eae5-4722-9ff9-feda0e3b5a4b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.569451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 253/523] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:28.569451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9b239-eae5-4722-9ff9-feda0e3b5a4b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.581411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de511909-440d-4f95-a960-6f03ffefb54f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.621895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0dc1a-9e3b-4346-9808-bc9c3c66f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.622636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0dc1a-9e3b-4346-9808-bc9c3c66f05e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.622924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0dc1a-9e3b-4346-9808-bc9c3c66f05e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.623212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0dc1a-9e3b-4346-9808-bc9c3c66f05e None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.623904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0dc1a-9e3b-4346-9808-bc9c3c66f05e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:28.624214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0dc1a-9e3b-4346-9808-bc9c3c66f05e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.625677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0dc1a-9e3b-4346-9808-bc9c3c66f05e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.645730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 271/524] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:28.647039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0dc1a-9e3b-4346-9808-bc9c3c66f05e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.686605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9b239-eae5-4722-9ff9-feda0e3b5a4b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.697603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:28.721563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc64125-2af8-4b3a-843a-17dc39b5c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.722261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc64125-2af8-4b3a-843a-17dc39b5c233 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.722501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc64125-2af8-4b3a-843a-17dc39b5c233 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.722854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc64125-2af8-4b3a-843a-17dc39b5c233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.731215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc64125-2af8-4b3a-843a-17dc39b5c233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.732703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc64125-2af8-4b3a-843a-17dc39b5c233 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-edc64125-2af8-4b3a-843a-17dc39b5c233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:28.744598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:28.745651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:28.746775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:28.746775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:28.746775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:28.746775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:28.746775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:28.746775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:28.746775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:28.746775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:28.746775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 254/525] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:28.747255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc64125-2af8-4b3a-843a-17dc39b5c233 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.758781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0dc1a-9e3b-4346-9808-bc9c3c66f05e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.779068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:28.793842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0a0d-6f52-473f-acef-05cc5aa48edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.794498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0a0d-6f52-473f-acef-05cc5aa48edf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.794784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0a0d-6f52-473f-acef-05cc5aa48edf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.795064 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0a0d-6f52-473f-acef-05cc5aa48edf None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.795800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e0a0d-6f52-473f-acef-05cc5aa48edf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:28.796113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e0a0d-6f52-473f-acef-05cc5aa48edf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.797624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e0a0d-6f52-473f-acef-05cc5aa48edf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.816294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 272/526] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:28.817512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0a0d-6f52-473f-acef-05cc5aa48edf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.857960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc64125-2af8-4b3a-843a-17dc39b5c233 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.897096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f355d-c02d-4120-ad91-852de2fdb0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.897621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f355d-c02d-4120-ad91-852de2fdb0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.897956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f355d-c02d-4120-ad91-852de2fdb0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.898266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f355d-c02d-4120-ad91-852de2fdb0d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.922676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0a0d-6f52-473f-acef-05cc5aa48edf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:28.952014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:28.962124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096470d-ef9d-47de-984a-fc28d496a5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:28.962769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096470d-ef9d-47de-984a-fc28d496a5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:28.963071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096470d-ef9d-47de-984a-fc28d496a5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:28.963350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096470d-ef9d-47de-984a-fc28d496a5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:28.964081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096470d-ef9d-47de-984a-fc28d496a5c0 None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=9f31f738fe094e4ea7ed440e661e2111) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:28.964394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096470d-ef9d-47de-984a-fc28d496a5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.965839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096470d-ef9d-47de-984a-fc28d496a5c0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:28.971789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 273/527] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/role_assignments?user.id=9f31f738fe094e4ea7ed440e661e2111&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:28.972593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096470d-ef9d-47de-984a-fc28d496a5c0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:28.983421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f355d-c02d-4120-ad91-852de2fdb0d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:28.985154 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f355d-c02d-4120-ad91-852de2fdb0d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:29.039650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:29.109693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 255/528] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:29.111694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f355d-c02d-4120-ad91-852de2fdb0d6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:29.117861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096470d-ef9d-47de-984a-fc28d496a5c0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:29.158919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e1ca5-3e43-4c7a-9084-ae5c5964fbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:29.159875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e1ca5-3e43-4c7a-9084-ae5c5964fbad None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:29.160347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e1ca5-3e43-4c7a-9084-ae5c5964fbad None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:29.160809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e1ca5-3e43-4c7a-9084-ae5c5964fbad None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:29.161710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e1ca5-3e43-4c7a-9084-ae5c5964fbad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:29.162281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e1ca5-3e43-4c7a-9084-ae5c5964fbad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:29.163907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e1ca5-3e43-4c7a-9084-ae5c5964fbad None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:29.176887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 274/529] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:29.178010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e1ca5-3e43-4c7a-9084-ae5c5964fbad None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:29.218628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:29.257685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f355d-c02d-4120-ad91-852de2fdb0d6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:29.296904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00719a-2b41-4ee9-8010-7fddc8ec4d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:29.297863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00719a-2b41-4ee9-8010-7fddc8ec4d7d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:29.298364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00719a-2b41-4ee9-8010-7fddc8ec4d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:29.298849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00719a-2b41-4ee9-8010-7fddc8ec4d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:29.315427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e1ca5-3e43-4c7a-9084-ae5c5964fbad None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:29.317265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:29.364923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcb50e-3348-4d68-98b3-0ce042b27a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:29.365563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb50e-3348-4d68-98b3-0ce042b27a67 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:29.365842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb50e-3348-4d68-98b3-0ce042b27a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:29.366139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dcb50e-3348-4d68-98b3-0ce042b27a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:29.381710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcb50e-3348-4d68-98b3-0ce042b27a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:29.383352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dcb50e-3348-4d68-98b3-0ce042b27a67 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:29.389128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00719a-2b41-4ee9-8010-7fddc8ec4d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:29.390961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00719a-2b41-4ee9-8010-7fddc8ec4d7d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a7dcb50e-3348-4d68-98b3-0ce042b27a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:29.404835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:29.405766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:29.406637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:29.406637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:29.406637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:29.410276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 275/530] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:29.411552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcb50e-3348-4d68-98b3-0ce042b27a67 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:29.477538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:29.515209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dcb50e-3348-4d68-98b3-0ce042b27a67 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:29.525974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 256/531] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:29.527162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00719a-2b41-4ee9-8010-7fddc8ec4d7d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:29.559374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dbede-1594-41cf-8d04-595280268639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:29.559974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dbede-1594-41cf-8d04-595280268639 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:29.560255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dbede-1594-41cf-8d04-595280268639 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:29.560533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dbede-1594-41cf-8d04-595280268639 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:29.561301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dbede-1594-41cf-8d04-595280268639 None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=8a8339b6461e4e28bc397dcd3f85e1a3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:29.561613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dbede-1594-41cf-8d04-595280268639 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:29.563233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dbede-1594-41cf-8d04-595280268639 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:29.578127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 276/532] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:29 2022] GET /identity/v3/role_assignments?user.id=8a8339b6461e4e28bc397dcd3f85e1a3&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:29.578127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dbede-1594-41cf-8d04-595280268639 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:29.614713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:29.698102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00719a-2b41-4ee9-8010-7fddc8ec4d7d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:29.769198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7350-92c5-4366-96d0-580d9ddb277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:29.771471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7350-92c5-4366-96d0-580d9ddb277d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:29.773538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7350-92c5-4366-96d0-580d9ddb277d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:29.774063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7350-92c5-4366-96d0-580d9ddb277d None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:29.775281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b7350-92c5-4366-96d0-580d9ddb277d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:29.777216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b7350-92c5-4366-96d0-580d9ddb277d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:29.778647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b7350-92c5-4366-96d0-580d9ddb277d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:29.792560 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 257/533] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:29.797613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dbede-1594-41cf-8d04-595280268639 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:29.801045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7350-92c5-4366-96d0-580d9ddb277d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:29.834695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc84c-343c-4d32-a72d-c051dabfbff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:29.835323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc84c-343c-4d32-a72d-c051dabfbff2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:29.835602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc84c-343c-4d32-a72d-c051dabfbff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:29.835871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc84c-343c-4d32-a72d-c051dabfbff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:29.846927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cc84c-343c-4d32-a72d-c051dabfbff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:29.850166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cc84c-343c-4d32-a72d-c051dabfbff2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3d0cc84c-343c-4d32-a72d-c051dabfbff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:29.865154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:29.866095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:29.866964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:29.866964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:29.866964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:29.866964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 277/534] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:29.868211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:29.874521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc84c-343c-4d32-a72d-c051dabfbff2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:29.966759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:30.002230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc84c-343c-4d32-a72d-c051dabfbff2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:30.039810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1df85-e29c-440a-94d7-8c64a3cf96ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:30.041613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1df85-e29c-440a-94d7-8c64a3cf96ea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:30.042040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1df85-e29c-440a-94d7-8c64a3cf96ea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:30.042676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1df85-e29c-440a-94d7-8c64a3cf96ea None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:30.043449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1df85-e29c-440a-94d7-8c64a3cf96ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:30.043924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1df85-e29c-440a-94d7-8c64a3cf96ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:30.045419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1df85-e29c-440a-94d7-8c64a3cf96ea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:30.048308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7350-92c5-4366-96d0-580d9ddb277d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:30.063071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 278/535] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:30.064725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1df85-e29c-440a-94d7-8c64a3cf96ea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:30.141849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33765cd-8480-40e9-8730-5f18f538e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:30.142534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33765cd-8480-40e9-8730-5f18f538e804 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:30.142822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33765cd-8480-40e9-8730-5f18f538e804 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:30.143106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33765cd-8480-40e9-8730-5f18f538e804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:30.159261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33765cd-8480-40e9-8730-5f18f538e804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:30.161463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33765cd-8480-40e9-8730-5f18f538e804 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d33765cd-8480-40e9-8730-5f18f538e804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:30.185381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:30.189920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 258/536] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:30.191021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33765cd-8480-40e9-8730-5f18f538e804 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:30.216600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1df85-e29c-440a-94d7-8c64a3cf96ea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:30.283832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:30.291468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:30.297636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94b400-39a8-47c6-98de-4d6328a3e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:30.298315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94b400-39a8-47c6-98de-4d6328a3e953 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:30.298598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94b400-39a8-47c6-98de-4d6328a3e953 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:30.298893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94b400-39a8-47c6-98de-4d6328a3e953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:30.301034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33765cd-8480-40e9-8730-5f18f538e804 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:30.311570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94b400-39a8-47c6-98de-4d6328a3e953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:30.313046 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94b400-39a8-47c6-98de-4d6328a3e953 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-be94b400-39a8-47c6-98de-4d6328a3e953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:30.326533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:30.327437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:30.328262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:30.328262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:30.328262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:30.328262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:30.328262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:30.328262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:30.328262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:30.328262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:30.328262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 279/537] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:30.339156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94b400-39a8-47c6-98de-4d6328a3e953 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:30.347596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145e66-9394-4742-9d6c-f0dca56d212c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:30.349654 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145e66-9394-4742-9d6c-f0dca56d212c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:30.354713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145e66-9394-4742-9d6c-f0dca56d212c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:30.355418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f145e66-9394-4742-9d6c-f0dca56d212c None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:30.356274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f145e66-9394-4742-9d6c-f0dca56d212c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:30.356738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f145e66-9394-4742-9d6c-f0dca56d212c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:30.358357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f145e66-9394-4742-9d6c-f0dca56d212c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:30.399156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 259/538] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:30.406332 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145e66-9394-4742-9d6c-f0dca56d212c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:30.527396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f145e66-9394-4742-9d6c-f0dca56d212c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:30.540246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94b400-39a8-47c6-98de-4d6328a3e953 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:30.563166 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e469ec-9564-4607-bbef-59db2cc0b2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:30.564142 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e469ec-9564-4607-bbef-59db2cc0b2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:30.564621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e469ec-9564-4607-bbef-59db2cc0b2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:30.565090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e469ec-9564-4607-bbef-59db2cc0b2e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:30.566188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e469ec-9564-4607-bbef-59db2cc0b2e5 None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=d4f8f6b881a9476bb0951bc68d17ca70) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:30.566754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e469ec-9564-4607-bbef-59db2cc0b2e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:30.568505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e469ec-9564-4607-bbef-59db2cc0b2e5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:30.574717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 260/539] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:30 2022] GET /identity/v3/role_assignments?user.id=d4f8f6b881a9476bb0951bc68d17ca70&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:30.596115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d1e69-1969-462b-96d3-4bc4c200eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:30.596782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1e69-1969-462b-96d3-4bc4c200eed2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:30.597067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1e69-1969-462b-96d3-4bc4c200eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:30.597340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1e69-1969-462b-96d3-4bc4c200eed2 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:30.598120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d1e69-1969-462b-96d3-4bc4c200eed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:30.598437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d1e69-1969-462b-96d3-4bc4c200eed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:30.599915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d1e69-1969-462b-96d3-4bc4c200eed2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:30.614596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 280/540] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:30.620518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e469ec-9564-4607-bbef-59db2cc0b2e5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:30.644237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:30.758850 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e469ec-9564-4607-bbef-59db2cc0b2e5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:30.795383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73de4b0-e625-4fa8-b502-8b8ea0a06349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:30.796008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de4b0-e625-4fa8-b502-8b8ea0a06349 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:30.796246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de4b0-e625-4fa8-b502-8b8ea0a06349 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:30.796467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73de4b0-e625-4fa8-b502-8b8ea0a06349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:30.797215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de4b0-e625-4fa8-b502-8b8ea0a06349 None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=e0b66989d4df4398ad723f587cbc24bd) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:30.797529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de4b0-e625-4fa8-b502-8b8ea0a06349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:30.799047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73de4b0-e625-4fa8-b502-8b8ea0a06349 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:30.804842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975b809-dd5a-44d4-8a29-4efe24f26640 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:30.805361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975b809-dd5a-44d4-8a29-4efe24f26640 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:30.805435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975b809-dd5a-44d4-8a29-4efe24f26640 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:30.805774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 261/541] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:30 2022] GET /identity/v3/role_assignments?user.id=e0b66989d4df4398ad723f587cbc24bd&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:30.814775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 281/542] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:30.830057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415da5b6-63d4-4293-b506-7a0e1000419a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:30.830403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415da5b6-63d4-4293-b506-7a0e1000419a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:30.830652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415da5b6-63d4-4293-b506-7a0e1000419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:30.852414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-415da5b6-63d4-4293-b506-7a0e1000419a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:30.854313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-415da5b6-63d4-4293-b506-7a0e1000419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:30.939907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 262/543] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:31.385130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e45ea-a4e5-4d62-900b-ad84b1ebd318 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:31.385130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e45ea-a4e5-4d62-900b-ad84b1ebd318 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:31.385130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e45ea-a4e5-4d62-900b-ad84b1ebd318 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:31.386756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 282/544] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:31.386979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415da5b6-63d4-4293-b506-7a0e1000419a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:31.392313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a377f4-c329-4444-9111-67ff3285de12 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:31.392613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a377f4-c329-4444-9111-67ff3285de12 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:31.392866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a377f4-c329-4444-9111-67ff3285de12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:31.397702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:31.419139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b8a377f4-c329-4444-9111-67ff3285de12 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:31.420350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b8a377f4-c329-4444-9111-67ff3285de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:31.491557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415da5b6-63d4-4293-b506-7a0e1000419a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:31.494840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:31.528497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9303a-d1ee-4a74-b88f-df902669b07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:31.529135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9303a-d1ee-4a74-b88f-df902669b07a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:31.529418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9303a-d1ee-4a74-b88f-df902669b07a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:31.529693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9303a-d1ee-4a74-b88f-df902669b07a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:31.532169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 283/545] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:31.543000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9303a-d1ee-4a74-b88f-df902669b07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-15d9303a-d1ee-4a74-b88f-df902669b07a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:31.547819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:31.548678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:31.549451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 263/546] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:31.554954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a377f4-c329-4444-9111-67ff3285de12 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:31.658380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a377f4-c329-4444-9111-67ff3285de12 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:31.708495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b7f8e-dcef-477e-bae6-5bfa1d352aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:31.709110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b7f8e-dcef-477e-bae6-5bfa1d352aec None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:31.709429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b7f8e-dcef-477e-bae6-5bfa1d352aec None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:31.709710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b7f8e-dcef-477e-bae6-5bfa1d352aec None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:31.710415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b7f8e-dcef-477e-bae6-5bfa1d352aec None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:31.710772 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b7f8e-dcef-477e-bae6-5bfa1d352aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:31.712231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b7f8e-dcef-477e-bae6-5bfa1d352aec None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:31.725725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 284/547] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:31.732246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9303a-d1ee-4a74-b88f-df902669b07a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:31.802819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:31.836544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9303a-d1ee-4a74-b88f-df902669b07a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:31.869145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b7f8e-dcef-477e-bae6-5bfa1d352aec None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:31.874039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc97f-40e0-4e66-b24c-0da49fff07fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:31.874710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc97f-40e0-4e66-b24c-0da49fff07fe None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:31.874983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc97f-40e0-4e66-b24c-0da49fff07fe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:31.875248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fc97f-40e0-4e66-b24c-0da49fff07fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:31.898452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fc97f-40e0-4e66-b24c-0da49fff07fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:31.900287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fc97f-40e0-4e66-b24c-0da49fff07fe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-453fc97f-40e0-4e66-b24c-0da49fff07fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:31.927420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:31.929532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:31.932680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:31.932680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:31.932680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:31.935016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 264/548] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:31.937735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc97f-40e0-4e66-b24c-0da49fff07fe None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:31.967154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:32.089352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fc97f-40e0-4e66-b24c-0da49fff07fe None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:32.091797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b7f8e-dcef-477e-bae6-5bfa1d352aec None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:32.110643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:32.129202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f7907-f7f6-48b0-891e-d7c9814756ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:32.130265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f7907-f7f6-48b0-891e-d7c9814756ca None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.130798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f7907-f7f6-48b0-891e-d7c9814756ca None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.134032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f7907-f7f6-48b0-891e-d7c9814756ca None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.134939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f7907-f7f6-48b0-891e-d7c9814756ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:32.135472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f7907-f7f6-48b0-891e-d7c9814756ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:32.137084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f7907-f7f6-48b0-891e-d7c9814756ca None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:32.153747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 265/549] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:32.160854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f7907-f7f6-48b0-891e-d7c9814756ca None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:32.162818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0450-5f1c-4a0b-9f9d-68dffc184c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:32.163456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0450-5f1c-4a0b-9f9d-68dffc184c32 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.163738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0450-5f1c-4a0b-9f9d-68dffc184c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.164012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0450-5f1c-4a0b-9f9d-68dffc184c32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.193550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c0450-5f1c-4a0b-9f9d-68dffc184c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-135c0450-5f1c-4a0b-9f9d-68dffc184c32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:32.199292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:32.200288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:32.201110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:32.207253 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 285/550] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:32.211924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0450-5f1c-4a0b-9f9d-68dffc184c32 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:32.275938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f7907-f7f6-48b0-891e-d7c9814756ca None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:32.314288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbab08-4679-41a0-858f-e29e760d03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:32.315381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbab08-4679-41a0-858f-e29e760d03c8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.315925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbab08-4679-41a0-858f-e29e760d03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.316383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbab08-4679-41a0-858f-e29e760d03c8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.325541 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbab08-4679-41a0-858f-e29e760d03c8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:32.327272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbab08-4679-41a0-858f-e29e760d03c8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-13cbab08-4679-41a0-858f-e29e760d03c8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:32.340333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:32.341288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:32.342264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:32.347866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 266/551] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:32.347866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9872e89-e138-46d6-96a8-0e566878f765 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.347866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9872e89-e138-46d6-96a8-0e566878f765 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.347866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9872e89-e138-46d6-96a8-0e566878f765 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.350367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 267/552] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:32.351356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9872e89-e138-46d6-96a8-0e566878f765 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:32.364105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0450-5f1c-4a0b-9f9d-68dffc184c32 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:32.365712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:32.403310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:32.407290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa02251-4101-4249-8757-e8b7c48c893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:32.408487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02251-4101-4249-8757-e8b7c48c893c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.409020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02251-4101-4249-8757-e8b7c48c893c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.409398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa02251-4101-4249-8757-e8b7c48c893c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.410998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa02251-4101-4249-8757-e8b7c48c893c None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:32.411552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa02251-4101-4249-8757-e8b7c48c893c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:32.413336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa02251-4101-4249-8757-e8b7c48c893c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:32.428507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 286/553] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:32.428507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b584dee-b225-4f29-b25f-02c870e2e15c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.428507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b584dee-b225-4f29-b25f-02c870e2e15c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.428507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b584dee-b225-4f29-b25f-02c870e2e15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.451180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0b584dee-b225-4f29-b25f-02c870e2e15c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:32.453074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b584dee-b225-4f29-b25f-02c870e2e15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:32.484414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9872e89-e138-46d6-96a8-0e566878f765 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:32.526986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24a33c-23d5-450f-ab9a-a543f38db398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:32.527691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24a33c-23d5-450f-ab9a-a543f38db398 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.528037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24a33c-23d5-450f-ab9a-a543f38db398 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.528386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24a33c-23d5-450f-ab9a-a543f38db398 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.529274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24a33c-23d5-450f-ab9a-a543f38db398 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:32.529685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24a33c-23d5-450f-ab9a-a543f38db398 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:32.531066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 287/554] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:32.531354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24a33c-23d5-450f-ab9a-a543f38db398 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:32.532359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b584dee-b225-4f29-b25f-02c870e2e15c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:32.557099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 268/555] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 08:43:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:32.564917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24a33c-23d5-450f-ab9a-a543f38db398 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:32.635297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:32.646103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b584dee-b225-4f29-b25f-02c870e2e15c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:32.678817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8333e-777d-437a-b551-df31cb164373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:32.679208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8333e-777d-437a-b551-df31cb164373 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.679541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8333e-777d-437a-b551-df31cb164373 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.679823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8333e-777d-437a-b551-df31cb164373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.690389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8333e-777d-437a-b551-df31cb164373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:32.691968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8333e-777d-437a-b551-df31cb164373 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-86d8333e-777d-437a-b551-df31cb164373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:32.709877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:32.710917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:32.713670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:32.713670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:32.713670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:32.713670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 288/556] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:32.719782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8333e-777d-437a-b551-df31cb164373 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:32.743957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:32.748801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24a33c-23d5-450f-ab9a-a543f38db398 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:32.813309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb996f-4190-467e-b6a4-e900d458b03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:32.814843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb996f-4190-467e-b6a4-e900d458b03a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.815329 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb996f-4190-467e-b6a4-e900d458b03a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.815915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb996f-4190-467e-b6a4-e900d458b03a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.823411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8333e-777d-437a-b551-df31cb164373 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:32.859807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2e14-f2f7-43b0-b293-0bb447a23b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:32.860426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2e14-f2f7-43b0-b293-0bb447a23b0c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.860712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2e14-f2f7-43b0-b293-0bb447a23b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.860989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2e14-f2f7-43b0-b293-0bb447a23b0c None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.861702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2e14-f2f7-43b0-b293-0bb447a23b0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:32.862013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2e14-f2f7-43b0-b293-0bb447a23b0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:32.863571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2e14-f2f7-43b0-b293-0bb447a23b0c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:32.876323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 289/557] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:32.881753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2e14-f2f7-43b0-b293-0bb447a23b0c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:32.924159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:32.968078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb996f-4190-467e-b6a4-e900d458b03a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:32.969580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb996f-4190-467e-b6a4-e900d458b03a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:33.067634 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2e14-f2f7-43b0-b293-0bb447a23b0c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:33.103476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:33.108568 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 269/558] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:33.109404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb996f-4190-467e-b6a4-e900d458b03a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.116624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826ebe5-5b34-48db-a342-b25032c46c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:33.118459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826ebe5-5b34-48db-a342-b25032c46c35 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.118910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826ebe5-5b34-48db-a342-b25032c46c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.119344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826ebe5-5b34-48db-a342-b25032c46c35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.129402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826ebe5-5b34-48db-a342-b25032c46c35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:33.131540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826ebe5-5b34-48db-a342-b25032c46c35 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1826ebe5-5b34-48db-a342-b25032c46c35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:33.150566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:33.151558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:33.152461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:33.154433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 290/559] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 08:43:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:33.155462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826ebe5-5b34-48db-a342-b25032c46c35 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.233996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb996f-4190-467e-b6a4-e900d458b03a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:33.254840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:33.274066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ae86-b219-45e1-a403-2a5987090b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:33.274765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ae86-b219-45e1-a403-2a5987090b11 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.275043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ae86-b219-45e1-a403-2a5987090b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.275329 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4ae86-b219-45e1-a403-2a5987090b11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.287339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4ae86-b219-45e1-a403-2a5987090b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-52e4ae86-b219-45e1-a403-2a5987090b11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:33.293172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:33.294117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:33.294987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:33.298380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 270/560] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:33.299232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ae86-b219-45e1-a403-2a5987090b11 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.303856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826ebe5-5b34-48db-a342-b25032c46c35 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:33.340990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c1ad-6355-46fd-829e-ac69735e6b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:33.341623 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c1ad-6355-46fd-829e-ac69735e6b04 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.341902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c1ad-6355-46fd-829e-ac69735e6b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.342218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c1ad-6355-46fd-829e-ac69735e6b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.353237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c1ad-6355-46fd-829e-ac69735e6b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:33.354995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c1ad-6355-46fd-829e-ac69735e6b04 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:33.361023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6de4c1ad-6355-46fd-829e-ac69735e6b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:33.369709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:33.370746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:33.371633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:33.371633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:33.371633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:33.371633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 291/561] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:33.371633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c1ad-6355-46fd-829e-ac69735e6b04 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.405255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4ae86-b219-45e1-a403-2a5987090b11 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:33.440093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20e0de-7db9-4aaf-a682-51805f56554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:33.440696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20e0de-7db9-4aaf-a682-51805f56554b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.440978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20e0de-7db9-4aaf-a682-51805f56554b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.441255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20e0de-7db9-4aaf-a682-51805f56554b None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.441988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20e0de-7db9-4aaf-a682-51805f56554b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:33.442327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20e0de-7db9-4aaf-a682-51805f56554b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:33.443813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20e0de-7db9-4aaf-a682-51805f56554b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:33.461102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 271/562] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:33.462284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc981457-ad38-4aef-999a-a464aba81c35 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.462574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc981457-ad38-4aef-999a-a464aba81c35 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.462901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc981457-ad38-4aef-999a-a464aba81c35 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.466122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 272/563] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:33.466122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2234b-c8db-4805-804c-c990fae07e7f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.466122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2234b-c8db-4805-804c-c990fae07e7f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.466393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2234b-c8db-4805-804c-c990fae07e7f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.471190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 273/564] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:33.471190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2234b-c8db-4805-804c-c990fae07e7f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.474330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c1ad-6355-46fd-829e-ac69735e6b04 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:33.492140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:33.509125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71111f9-8015-47a8-9701-d2e157d1c5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:33.512325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71111f9-8015-47a8-9701-d2e157d1c5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.512325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71111f9-8015-47a8-9701-d2e157d1c5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.512325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71111f9-8015-47a8-9701-d2e157d1c5c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.512325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71111f9-8015-47a8-9701-d2e157d1c5c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:33.512325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71111f9-8015-47a8-9701-d2e157d1c5c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:33.512719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71111f9-8015-47a8-9701-d2e157d1c5c2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:33.521335 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 292/565] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:33.522140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71111f9-8015-47a8-9701-d2e157d1c5c2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.566995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2234b-c8db-4805-804c-c990fae07e7f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:33.582800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:33.599816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215e8b9-97d1-44c7-9ea6-dc4b373c85f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:33.601128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215e8b9-97d1-44c7-9ea6-dc4b373c85f3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.601128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215e8b9-97d1-44c7-9ea6-dc4b373c85f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.601128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215e8b9-97d1-44c7-9ea6-dc4b373c85f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.601739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215e8b9-97d1-44c7-9ea6-dc4b373c85f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:33.602040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215e8b9-97d1-44c7-9ea6-dc4b373c85f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:33.604085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215e8b9-97d1-44c7-9ea6-dc4b373c85f3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:33.615083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 274/566] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:33.616297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cff879-f495-43c3-8cb7-a44f64a19879 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.616708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cff879-f495-43c3-8cb7-a44f64a19879 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.616985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cff879-f495-43c3-8cb7-a44f64a19879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.626503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71111f9-8015-47a8-9701-d2e157d1c5c2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:33.634502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-66cff879-f495-43c3-8cb7-a44f64a19879 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:33.635682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-66cff879-f495-43c3-8cb7-a44f64a19879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:33.660135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193943b-8058-4c49-b166-e3339c262f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:33.660757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193943b-8058-4c49-b166-e3339c262f3c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.661037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193943b-8058-4c49-b166-e3339c262f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.661315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193943b-8058-4c49-b166-e3339c262f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.672355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193943b-8058-4c49-b166-e3339c262f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:33.673824 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193943b-8058-4c49-b166-e3339c262f3c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e193943b-8058-4c49-b166-e3339c262f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:33.689379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:33.690554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:33.691616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:33.691616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:33.691616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:33.691616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 293/567] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:33.691616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909463c-48f3-4cea-bac6-72a05ebf1fba None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.691951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909463c-48f3-4cea-bac6-72a05ebf1fba None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.692160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909463c-48f3-4cea-bac6-72a05ebf1fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.703094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 275/568] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:33.703918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cff879-f495-43c3-8cb7-a44f64a19879 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.709394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5909463c-48f3-4cea-bac6-72a05ebf1fba None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:33.710618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5909463c-48f3-4cea-bac6-72a05ebf1fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:33.737249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:33.790275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 294/569] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:33.790275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909463c-48f3-4cea-bac6-72a05ebf1fba None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.832534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cff879-f495-43c3-8cb7-a44f64a19879 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:33.846886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:33.880566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d74c5-5644-4501-9f02-0ca13f480e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:33.882164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d74c5-5644-4501-9f02-0ca13f480e2a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.882925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d74c5-5644-4501-9f02-0ca13f480e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.883404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d74c5-5644-4501-9f02-0ca13f480e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.891078 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909463c-48f3-4cea-bac6-72a05ebf1fba None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:33.898076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d74c5-5644-4501-9f02-0ca13f480e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:33.900882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d74c5-5644-4501-9f02-0ca13f480e2a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9c6d74c5-5644-4501-9f02-0ca13f480e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:33.922970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:33.923952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:33.924855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:33.924855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:33.924855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:33.929115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 276/570] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:33.929720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d74c5-5644-4501-9f02-0ca13f480e2a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.937866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac0c6b-fdd3-49b9-b9ca-3edddf829f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:33.938828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac0c6b-fdd3-49b9-b9ca-3edddf829f77 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:33.939305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac0c6b-fdd3-49b9-b9ca-3edddf829f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:33.939839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac0c6b-fdd3-49b9-b9ca-3edddf829f77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:33.949486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac0c6b-fdd3-49b9-b9ca-3edddf829f77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:33.951205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac0c6b-fdd3-49b9-b9ca-3edddf829f77 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cfac0c6b-fdd3-49b9-b9ca-3edddf829f77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:33.963383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:33.964271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:33.965142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:33.965142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:33.965142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:33.965142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:33.965142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:33.965142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:33.965142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:33.965142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:33.967253 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 295/571] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:33.968383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac0c6b-fdd3-49b9-b9ca-3edddf829f77 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:33.998730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:34.045452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d74c5-5644-4501-9f02-0ca13f480e2a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.075014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac0c6b-fdd3-49b9-b9ca-3edddf829f77 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.078099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4471c8-4b41-4bd0-9aea-873a1171e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.078721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4471c8-4b41-4bd0-9aea-873a1171e671 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.079002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4471c8-4b41-4bd0-9aea-873a1171e671 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.079274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4471c8-4b41-4bd0-9aea-873a1171e671 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.079915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4471c8-4b41-4bd0-9aea-873a1171e671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:34.080218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4471c8-4b41-4bd0-9aea-873a1171e671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.081590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4471c8-4b41-4bd0-9aea-873a1171e671 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.093007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 277/572] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:34.093903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4471c8-4b41-4bd0-9aea-873a1171e671 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.111500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1558fac-67c3-4a09-8d49-53c55b6b851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.112103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1558fac-67c3-4a09-8d49-53c55b6b851a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.112380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1558fac-67c3-4a09-8d49-53c55b6b851a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.112652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1558fac-67c3-4a09-8d49-53c55b6b851a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.113292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1558fac-67c3-4a09-8d49-53c55b6b851a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:34.113593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1558fac-67c3-4a09-8d49-53c55b6b851a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.114997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1558fac-67c3-4a09-8d49-53c55b6b851a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.115142 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:34.126595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 296/573] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:34.127449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1558fac-67c3-4a09-8d49-53c55b6b851a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.198894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4471c8-4b41-4bd0-9aea-873a1171e671 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.206318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:34.223724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1558fac-67c3-4a09-8d49-53c55b6b851a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.231981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fecd2-bc0f-44cd-85ba-daa966cd9808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.232577 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fecd2-bc0f-44cd-85ba-daa966cd9808 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.232855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fecd2-bc0f-44cd-85ba-daa966cd9808 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.233128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fecd2-bc0f-44cd-85ba-daa966cd9808 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.233814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fecd2-bc0f-44cd-85ba-daa966cd9808 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:34.234152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fecd2-bc0f-44cd-85ba-daa966cd9808 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.235567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fecd2-bc0f-44cd-85ba-daa966cd9808 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.247204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 278/574] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:34.248175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fecd2-bc0f-44cd-85ba-daa966cd9808 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.262173 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cc4d5-763a-421b-9d7f-2ab6e16ccd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.262802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cc4d5-763a-421b-9d7f-2ab6e16ccd20 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.263078 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cc4d5-763a-421b-9d7f-2ab6e16ccd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.263348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cc4d5-763a-421b-9d7f-2ab6e16ccd20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.273209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cc4d5-763a-421b-9d7f-2ab6e16ccd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b72cc4d5-763a-421b-9d7f-2ab6e16ccd20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:34.278525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:34.279423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:34.280251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 297/575] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:34.281407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cc4d5-763a-421b-9d7f-2ab6e16ccd20 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.324698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:34.345011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fecd2-bc0f-44cd-85ba-daa966cd9808 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.377547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa54027-c943-4481-be14-f6df881617bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.377737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cc4d5-763a-421b-9d7f-2ab6e16ccd20 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.378198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa54027-c943-4481-be14-f6df881617bb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.378480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa54027-c943-4481-be14-f6df881617bb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.378751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa54027-c943-4481-be14-f6df881617bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.388781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa54027-c943-4481-be14-f6df881617bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-baa54027-c943-4481-be14-f6df881617bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:34.393968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:34.394974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 279/576] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:34.395815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa54027-c943-4481-be14-f6df881617bb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.413391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf653b43-673c-4110-b859-1715d0d069a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.414018 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf653b43-673c-4110-b859-1715d0d069a1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.414344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf653b43-673c-4110-b859-1715d0d069a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.414623 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf653b43-673c-4110-b859-1715d0d069a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.422061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf653b43-673c-4110-b859-1715d0d069a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.423540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf653b43-673c-4110-b859-1715d0d069a1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cf653b43-673c-4110-b859-1715d0d069a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:34.434587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:34.435568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 298/577] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:34.436486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf653b43-673c-4110-b859-1715d0d069a1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.442556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:34.496367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa54027-c943-4481-be14-f6df881617bb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.527734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac294e-2b23-446d-abec-c61ff26c416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.528346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac294e-2b23-446d-abec-c61ff26c416c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.528625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac294e-2b23-446d-abec-c61ff26c416c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.528895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac294e-2b23-446d-abec-c61ff26c416c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.535891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac294e-2b23-446d-abec-c61ff26c416c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.536517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf653b43-673c-4110-b859-1715d0d069a1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.537326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac294e-2b23-446d-abec-c61ff26c416c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.539278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bfac294e-2b23-446d-abec-c61ff26c416c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:34.549162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:34.553630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 280/578] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:34.554653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac294e-2b23-446d-abec-c61ff26c416c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.575984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13e0a-c25d-4e48-9788-c314ae8f37dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.576521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13e0a-c25d-4e48-9788-c314ae8f37dd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.576808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13e0a-c25d-4e48-9788-c314ae8f37dd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.577087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf13e0a-c25d-4e48-9788-c314ae8f37dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.577816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf13e0a-c25d-4e48-9788-c314ae8f37dd None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=88353e858ec64a9cbdcfd16dbc00ebe3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:34.578160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf13e0a-c25d-4e48-9788-c314ae8f37dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.579636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf13e0a-c25d-4e48-9788-c314ae8f37dd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.584804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 299/579] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/role_assignments?user.id=88353e858ec64a9cbdcfd16dbc00ebe3&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:34.585576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13e0a-c25d-4e48-9788-c314ae8f37dd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.664500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:34.669637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac294e-2b23-446d-abec-c61ff26c416c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.703558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf13e0a-c25d-4e48-9788-c314ae8f37dd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.706744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9f9f0-cd7b-40ce-9d74-7c5e5b869f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.707366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9f9f0-cd7b-40ce-9d74-7c5e5b869f47 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.707649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9f9f0-cd7b-40ce-9d74-7c5e5b869f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.707923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9f9f0-cd7b-40ce-9d74-7c5e5b869f47 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.708614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9f9f0-cd7b-40ce-9d74-7c5e5b869f47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:34.708921 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9f9f0-cd7b-40ce-9d74-7c5e5b869f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.710366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9f9f0-cd7b-40ce-9d74-7c5e5b869f47 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.720321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 281/580] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:34.721189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9f9f0-cd7b-40ce-9d74-7c5e5b869f47 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.749022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c839df-7fef-45d6-a03a-c6d1a33ec192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.749954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c839df-7fef-45d6-a03a-c6d1a33ec192 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.750470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c839df-7fef-45d6-a03a-c6d1a33ec192 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.750942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c839df-7fef-45d6-a03a-c6d1a33ec192 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.751799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c839df-7fef-45d6-a03a-c6d1a33ec192 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:34.752106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c839df-7fef-45d6-a03a-c6d1a33ec192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.753504 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c839df-7fef-45d6-a03a-c6d1a33ec192 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.763778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 300/581] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:34.764600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c839df-7fef-45d6-a03a-c6d1a33ec192 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.789012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:34.851531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9f9f0-cd7b-40ce-9d74-7c5e5b869f47 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.885986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c839df-7fef-45d6-a03a-c6d1a33ec192 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:34.890220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8bc3-62d4-440c-a6df-da1a5183f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.890838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8bc3-62d4-440c-a6df-da1a5183f8ff None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.891121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8bc3-62d4-440c-a6df-da1a5183f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.891393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8bc3-62d4-440c-a6df-da1a5183f8ff None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.892091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f8bc3-62d4-440c-a6df-da1a5183f8ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:34.892398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f8bc3-62d4-440c-a6df-da1a5183f8ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.894272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f8bc3-62d4-440c-a6df-da1a5183f8ff None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.912740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 282/582] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:34.912740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8bc3-62d4-440c-a6df-da1a5183f8ff None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:34.917942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:34.926056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93995c-089d-4b45-a13b-057887f66c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:34.931338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93995c-089d-4b45-a13b-057887f66c01 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:34.931875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93995c-089d-4b45-a13b-057887f66c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:34.932346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93995c-089d-4b45-a13b-057887f66c01 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:34.933104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93995c-089d-4b45-a13b-057887f66c01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:34.933544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93995c-089d-4b45-a13b-057887f66c01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:34.935052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93995c-089d-4b45-a13b-057887f66c01 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:34.959100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 301/583] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:34.959100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93995c-089d-4b45-a13b-057887f66c01 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.020670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8bc3-62d4-440c-a6df-da1a5183f8ff None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.042277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.057200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6d511-60c6-4b76-ace7-86f8c868e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.058263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6d511-60c6-4b76-ace7-86f8c868e346 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.058556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6d511-60c6-4b76-ace7-86f8c868e346 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.058837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6d511-60c6-4b76-ace7-86f8c868e346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.066397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93995c-089d-4b45-a13b-057887f66c01 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.068872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6d511-60c6-4b76-ace7-86f8c868e346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.070357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6d511-60c6-4b76-ace7-86f8c868e346 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a3a6d511-60c6-4b76-ace7-86f8c868e346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:35.086307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:35.087827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:35.088694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:35.088694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:35.088694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:35.092672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 283/584] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:35.093252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6d511-60c6-4b76-ace7-86f8c868e346 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.104302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6a170-06d8-4529-af41-caa64f8e844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.105135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a170-06d8-4529-af41-caa64f8e844d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.105416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a170-06d8-4529-af41-caa64f8e844d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.105704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a170-06d8-4529-af41-caa64f8e844d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.116103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6a170-06d8-4529-af41-caa64f8e844d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.117578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6a170-06d8-4529-af41-caa64f8e844d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-88a6a170-06d8-4529-af41-caa64f8e844d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:35.132175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:35.133114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:35.134022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:35.134022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:35.134022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:35.137927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 302/585] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:35.138643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6a170-06d8-4529-af41-caa64f8e844d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.178528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.198146 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6d511-60c6-4b76-ace7-86f8c868e346 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.234895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e56cbb-1ecc-4667-b9af-e985cbd5a666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.235558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e56cbb-1ecc-4667-b9af-e985cbd5a666 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.235840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e56cbb-1ecc-4667-b9af-e985cbd5a666 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.236117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e56cbb-1ecc-4667-b9af-e985cbd5a666 None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/9f31f738fe094e4ea7ed440e661e2111/roles/a53d956761a64b18a7d7e76cbef98222` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.239603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6a170-06d8-4529-af41-caa64f8e844d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.250993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e56cbb-1ecc-4667-b9af-e985cbd5a666 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=9f31f738fe094e4ea7ed440e661e2111, role_id=a53d956761a64b18a7d7e76cbef98222)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.252444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e56cbb-1ecc-4667-b9af-e985cbd5a666 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.273368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a42b-6fb1-4ae1-8051-87b4a279e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.274057 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a42b-6fb1-4ae1-8051-87b4a279e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.274366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a42b-6fb1-4ae1-8051-87b4a279e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.275160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a42b-6fb1-4ae1-8051-87b4a279e3c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.285193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1a42b-6fb1-4ae1-8051-87b4a279e3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.286686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1a42b-6fb1-4ae1-8051-87b4a279e3c3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6eb1a42b-6fb1-4ae1-8051-87b4a279e3c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:35.301641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:35.302910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:35.304177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:35.304177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:35.304177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:35.306340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 303/586] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:35.307402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a42b-6fb1-4ae1-8051-87b4a279e3c3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.321808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 284/587] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:43:35 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/9f31f738fe094e4ea7ed440e661e2111/roles/a53d956761a64b18a7d7e76cbef98222 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:35.323412 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e56cbb-1ecc-4667-b9af-e985cbd5a666 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.365911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.411483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.422156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a42b-6fb1-4ae1-8051-87b4a279e3c3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.461141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e56cbb-1ecc-4667-b9af-e985cbd5a666 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.466260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11116-4dba-45ca-af8b-d2617748623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.834874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11116-4dba-45ca-af8b-d2617748623a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.834874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11116-4dba-45ca-af8b-d2617748623a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.834874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11116-4dba-45ca-af8b-d2617748623a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.834874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad11116-4dba-45ca-af8b-d2617748623a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:35.834874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad11116-4dba-45ca-af8b-d2617748623a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.834874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad11116-4dba-45ca-af8b-d2617748623a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.835359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 304/588] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:35.835359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11116-4dba-45ca-af8b-d2617748623a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.835502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8ab74-e52a-46b4-93f1-90b5153b4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.835502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8ab74-e52a-46b4-93f1-90b5153b4e4c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.835502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8ab74-e52a-46b4-93f1-90b5153b4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.835502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8ab74-e52a-46b4-93f1-90b5153b4e4c None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.835852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8ab74-e52a-46b4-93f1-90b5153b4e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:35.835852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8ab74-e52a-46b4-93f1-90b5153b4e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.835852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8ab74-e52a-46b4-93f1-90b5153b4e4c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.835852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 285/589] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:35.835852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8ab74-e52a-46b4-93f1-90b5153b4e4c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.836223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11116-4dba-45ca-af8b-d2617748623a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.836315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.836405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3393e-2534-4bf0-837f-c4c02bcd2955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.836405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3393e-2534-4bf0-837f-c4c02bcd2955 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.836405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3393e-2534-4bf0-837f-c4c02bcd2955 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.836405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3393e-2534-4bf0-837f-c4c02bcd2955 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.836732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3393e-2534-4bf0-837f-c4c02bcd2955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:35.836732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3393e-2534-4bf0-837f-c4c02bcd2955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.836732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3393e-2534-4bf0-837f-c4c02bcd2955 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.837485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8ab74-e52a-46b4-93f1-90b5153b4e4c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.837666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 305/590] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:35.837666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3393e-2534-4bf0-837f-c4c02bcd2955 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.837666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.837899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de800ed8-c4f1-4a8e-a0ce-9f5592c82eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.837899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de800ed8-c4f1-4a8e-a0ce-9f5592c82eaf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.837899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de800ed8-c4f1-4a8e-a0ce-9f5592c82eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.837899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de800ed8-c4f1-4a8e-a0ce-9f5592c82eaf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de800ed8-c4f1-4a8e-a0ce-9f5592c82eaf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de800ed8-c4f1-4a8e-a0ce-9f5592c82eaf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-de800ed8-c4f1-4a8e-a0ce-9f5592c82eaf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:35.838254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:35.839391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:35.841660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 286/591] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:35.843721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de800ed8-c4f1-4a8e-a0ce-9f5592c82eaf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.843868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3393e-2534-4bf0-837f-c4c02bcd2955 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.843868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194d600-3084-402b-b4c8-c111b40032fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.843868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194d600-3084-402b-b4c8-c111b40032fd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.843868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194d600-3084-402b-b4c8-c111b40032fd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.844423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194d600-3084-402b-b4c8-c111b40032fd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.845825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de800ed8-c4f1-4a8e-a0ce-9f5592c82eaf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.851452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194d600-3084-402b-b4c8-c111b40032fd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.853630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194d600-3084-402b-b4c8-c111b40032fd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7194d600-3084-402b-b4c8-c111b40032fd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:35.872492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:35.873700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:43:35.875261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:35.879522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 306/592] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:35.879522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194d600-3084-402b-b4c8-c111b40032fd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.893280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c908b-f618-4e8e-9853-3d490c560888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.894050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c908b-f618-4e8e-9853-3d490c560888 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.894925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c908b-f618-4e8e-9853-3d490c560888 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.895302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c908b-f618-4e8e-9853-3d490c560888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.905416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c908b-f618-4e8e-9853-3d490c560888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.907064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c908b-f618-4e8e-9853-3d490c560888 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a02c908b-f618-4e8e-9853-3d490c560888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:35.923910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:35.925000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:35.926103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:35.926103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:35.926103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:35.926103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:35.926103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:35.926103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:35.926103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:35.926103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:35.943361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 287/593] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:35.943939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c908b-f618-4e8e-9853-3d490c560888 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.948544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.974995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.014943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194d600-3084-402b-b4c8-c111b40032fd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.057603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7fe0b-8b02-447f-8f3f-1cad690eef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.058521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7fe0b-8b02-447f-8f3f-1cad690eef33 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.058966 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7fe0b-8b02-447f-8f3f-1cad690eef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.059400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7fe0b-8b02-447f-8f3f-1cad690eef33 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.060299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7fe0b-8b02-447f-8f3f-1cad690eef33 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:36.061164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7fe0b-8b02-447f-8f3f-1cad690eef33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.063212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7fe0b-8b02-447f-8f3f-1cad690eef33 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.075413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c908b-f618-4e8e-9853-3d490c560888 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.090278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 307/594] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:36.090278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7fe0b-8b02-447f-8f3f-1cad690eef33 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.117792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534ed12-c50f-4290-b352-65ab23c71163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.119158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534ed12-c50f-4290-b352-65ab23c71163 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.119381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534ed12-c50f-4290-b352-65ab23c71163 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.119651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534ed12-c50f-4290-b352-65ab23c71163 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.120401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534ed12-c50f-4290-b352-65ab23c71163 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:36.120711 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534ed12-c50f-4290-b352-65ab23c71163 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.122187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534ed12-c50f-4290-b352-65ab23c71163 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.140428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 288/595] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:36.141351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534ed12-c50f-4290-b352-65ab23c71163 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.202043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.208076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7fe0b-8b02-447f-8f3f-1cad690eef33 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.237371 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.244031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534ed12-c50f-4290-b352-65ab23c71163 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.246772 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cc623-0799-4004-8462-1f592b0f6a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.247627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cc623-0799-4004-8462-1f592b0f6a09 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.248126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cc623-0799-4004-8462-1f592b0f6a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.248607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cc623-0799-4004-8462-1f592b0f6a09 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.249645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cc623-0799-4004-8462-1f592b0f6a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:36.250198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cc623-0799-4004-8462-1f592b0f6a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.251916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cc623-0799-4004-8462-1f592b0f6a09 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.266031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 308/596] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:36.267336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cc623-0799-4004-8462-1f592b0f6a09 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.285604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa86a03-6858-4a29-aea2-eb26b4b9bc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.286652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa86a03-6858-4a29-aea2-eb26b4b9bc3d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.286652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa86a03-6858-4a29-aea2-eb26b4b9bc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.286861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa86a03-6858-4a29-aea2-eb26b4b9bc3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.298963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa86a03-6858-4a29-aea2-eb26b4b9bc3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.300434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa86a03-6858-4a29-aea2-eb26b4b9bc3d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-dfa86a03-6858-4a29-aea2-eb26b4b9bc3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:36.316172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:36.317178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:36.318099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:36.318099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:36.318099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:36.321938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 289/597] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:36.322811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa86a03-6858-4a29-aea2-eb26b4b9bc3d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.388559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cc623-0799-4004-8462-1f592b0f6a09 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.424500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa86a03-6858-4a29-aea2-eb26b4b9bc3d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.426341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47374-3967-40c6-9b32-e7c59607f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.427277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47374-3967-40c6-9b32-e7c59607f35f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.427765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47374-3967-40c6-9b32-e7c59607f35f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.428249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd47374-3967-40c6-9b32-e7c59607f35f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.437889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.441794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd47374-3967-40c6-9b32-e7c59607f35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.443629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd47374-3967-40c6-9b32-e7c59607f35f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.459419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8c78f-7624-427e-bad2-5337bacdcfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.460078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8c78f-7624-427e-bad2-5337bacdcfeb None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.460364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8c78f-7624-427e-bad2-5337bacdcfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.464540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8c78f-7624-427e-bad2-5337bacdcfeb None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/8a8339b6461e4e28bc397dcd3f85e1a3/roles/a53d956761a64b18a7d7e76cbef98222` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-afd47374-3967-40c6-9b32-e7c59607f35f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:36.464654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:36.465501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:36.466495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:36.466495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:36.466495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:36.466495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 309/598] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:36.466495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47374-3967-40c6-9b32-e7c59607f35f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.477911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8c78f-7624-427e-bad2-5337bacdcfeb None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=8a8339b6461e4e28bc397dcd3f85e1a3, role_id=a53d956761a64b18a7d7e76cbef98222)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.480269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8c78f-7624-427e-bad2-5337bacdcfeb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.512516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.558104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 290/599] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:43:36 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/8a8339b6461e4e28bc397dcd3f85e1a3/roles/a53d956761a64b18a7d7e76cbef98222 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:36.558104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8c78f-7624-427e-bad2-5337bacdcfeb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.610346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd47374-3967-40c6-9b32-e7c59607f35f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.684869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b89ad-8b84-4773-8f2a-27364323a3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.685410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b89ad-8b84-4773-8f2a-27364323a3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.685696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b89ad-8b84-4773-8f2a-27364323a3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.685972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b89ad-8b84-4773-8f2a-27364323a3c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.686677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b89ad-8b84-4773-8f2a-27364323a3c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:36.687035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b89ad-8b84-4773-8f2a-27364323a3c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.688447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b89ad-8b84-4773-8f2a-27364323a3c8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.714117 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 310/600] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:36.723626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b89ad-8b84-4773-8f2a-27364323a3c8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.757894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8c78f-7624-427e-bad2-5337bacdcfeb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.803182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70c26d-b53f-45ba-8a21-2e026b2926e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.803782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c26d-b53f-45ba-8a21-2e026b2926e3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.804063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c26d-b53f-45ba-8a21-2e026b2926e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.804335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c26d-b53f-45ba-8a21-2e026b2926e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.804984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70c26d-b53f-45ba-8a21-2e026b2926e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:36.805284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70c26d-b53f-45ba-8a21-2e026b2926e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.806722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70c26d-b53f-45ba-8a21-2e026b2926e3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.819111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 291/601] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:36.820418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e0df8-5592-4a26-a83e-ed9202b8f935 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.820703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e0df8-5592-4a26-a83e-ed9202b8f935 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.820976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e0df8-5592-4a26-a83e-ed9202b8f935 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.823125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 292/602] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:36.827202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e0df8-5592-4a26-a83e-ed9202b8f935 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:36.854052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.859894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b89ad-8b84-4773-8f2a-27364323a3c8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:36.862538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:36.896965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74271d4-1703-4df9-8cff-228d174b9e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:36.897598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74271d4-1703-4df9-8cff-228d174b9e3b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.897922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74271d4-1703-4df9-8cff-228d174b9e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.898228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74271d4-1703-4df9-8cff-228d174b9e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.906166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74271d4-1703-4df9-8cff-228d174b9e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:36.907602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74271d4-1703-4df9-8cff-228d174b9e3b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c74271d4-1703-4df9-8cff-228d174b9e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:36.921008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:36.921944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:36.923462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:36.923462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:36.923462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:36.923462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:36.923462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:36.923462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:36.923462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:36.923462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:36.923462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 311/603] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:36.924022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a53bb-def8-4f58-a726-02852fef7471 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:36.924022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a53bb-def8-4f58-a726-02852fef7471 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:36.924353 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a53bb-def8-4f58-a726-02852fef7471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:36.946099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6f7a53bb-def8-4f58-a726-02852fef7471 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:36.948694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6f7a53bb-def8-4f58-a726-02852fef7471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:36.975491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e0df8-5592-4a26-a83e-ed9202b8f935 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.019165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff9777-c793-4f57-92ce-8214267ef3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:37.020170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff9777-c793-4f57-92ce-8214267ef3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.020783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff9777-c793-4f57-92ce-8214267ef3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.021261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff9777-c793-4f57-92ce-8214267ef3f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.029139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff9777-c793-4f57-92ce-8214267ef3f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:37.030251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 312/604] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:37.031200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a53bb-def8-4f58-a726-02852fef7471 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:37.031700 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff9777-c793-4f57-92ce-8214267ef3f5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8cff9777-c793-4f57-92ce-8214267ef3f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:37.045985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:37.046955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:37.047831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:37.047831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:37.047831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:37.047831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:37.047831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:37.047831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:37.047831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:37.047831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:37.050940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 293/605] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:37.058139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff9777-c793-4f57-92ce-8214267ef3f5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:37.170458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:37.203612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff9777-c793-4f57-92ce-8214267ef3f5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.206475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:37.220250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a53bb-def8-4f58-a726-02852fef7471 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.257718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab24ee-dd78-49b9-80be-ed4fea666073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:37.258365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab24ee-dd78-49b9-80be-ed4fea666073 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.258647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab24ee-dd78-49b9-80be-ed4fea666073 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.259479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab24ee-dd78-49b9-80be-ed4fea666073 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.260179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab24ee-dd78-49b9-80be-ed4fea666073 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:37.260486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab24ee-dd78-49b9-80be-ed4fea666073 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:37.261919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab24ee-dd78-49b9-80be-ed4fea666073 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:37.274030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 313/606] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:37.285604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ba2da-4484-47f4-962c-4b757dab15e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:37.286266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba2da-4484-47f4-962c-4b757dab15e1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.286540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba2da-4484-47f4-962c-4b757dab15e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.286823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba2da-4484-47f4-962c-4b757dab15e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.287058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab24ee-dd78-49b9-80be-ed4fea666073 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:37.287527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ba2da-4484-47f4-962c-4b757dab15e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:37.287844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ba2da-4484-47f4-962c-4b757dab15e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:37.289283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ba2da-4484-47f4-962c-4b757dab15e1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:37.302741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 294/607] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:37.316666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ba2da-4484-47f4-962c-4b757dab15e1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:37.406137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab24ee-dd78-49b9-80be-ed4fea666073 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.448213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf11d9b-a9c6-4ee0-ac9f-69d619d12775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:37.449237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf11d9b-a9c6-4ee0-ac9f-69d619d12775 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.449754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf11d9b-a9c6-4ee0-ac9f-69d619d12775 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.450270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf11d9b-a9c6-4ee0-ac9f-69d619d12775 None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/e0b66989d4df4398ad723f587cbc24bd/roles/a53d956761a64b18a7d7e76cbef98222` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.452613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ba2da-4484-47f4-962c-4b757dab15e1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.466187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf11d9b-a9c6-4ee0-ac9f-69d619d12775 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=e0b66989d4df4398ad723f587cbc24bd, role_id=a53d956761a64b18a7d7e76cbef98222)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:37.468047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf11d9b-a9c6-4ee0-ac9f-69d619d12775 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:37.491664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb920a-9b87-460e-aafd-812c2912c0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:37.492327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb920a-9b87-460e-aafd-812c2912c0c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.492608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb920a-9b87-460e-aafd-812c2912c0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.493819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb920a-9b87-460e-aafd-812c2912c0c8 None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/d4f8f6b881a9476bb0951bc68d17ca70/roles/a53d956761a64b18a7d7e76cbef98222` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.505928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:37.509492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb920a-9b87-460e-aafd-812c2912c0c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=d4f8f6b881a9476bb0951bc68d17ca70, role_id=a53d956761a64b18a7d7e76cbef98222)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:37.510967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb920a-9b87-460e-aafd-812c2912c0c8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:37.556102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:37.560877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 314/608] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:43:37 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/e0b66989d4df4398ad723f587cbc24bd/roles/a53d956761a64b18a7d7e76cbef98222 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:37.561993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf11d9b-a9c6-4ee0-ac9f-69d619d12775 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:37.593334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 295/609] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:43:37 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/d4f8f6b881a9476bb0951bc68d17ca70/roles/a53d956761a64b18a7d7e76cbef98222 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:37.645869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cc341-c10d-4707-871a-6235fac18ac2 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.646175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cc341-c10d-4707-871a-6235fac18ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.646453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cc341-c10d-4707-871a-6235fac18ac2 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.648306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 296/610] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:43:37.654735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8005-5a14-474a-baea-1ba05e1a5ee8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.656176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8005-5a14-474a-baea-1ba05e1a5ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.656784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8005-5a14-474a-baea-1ba05e1a5ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.694708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-228e8005-5a14-474a-baea-1ba05e1a5ee8 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:37.696309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-228e8005-5a14-474a-baea-1ba05e1a5ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:37.747163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf11d9b-a9c6-4ee0-ac9f-69d619d12775 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.827069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85329d-432c-41c9-a8df-b84d8b697420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:37.830866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85329d-432c-41c9-a8df-b84d8b697420 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:37.831035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 297/611] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:37.831481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85329d-432c-41c9-a8df-b84d8b697420 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:37.831760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85329d-432c-41c9-a8df-b84d8b697420 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:37.848562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85329d-432c-41c9-a8df-b84d8b697420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dd85329d-432c-41c9-a8df-b84d8b697420 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:37.854030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:37.855484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:37.856480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 315/612] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:37.861584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8005-5a14-474a-baea-1ba05e1a5ee8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:37.970851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8005-5a14-474a-baea-1ba05e1a5ee8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:37.996478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:38.015249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75102a7c-c4c0-4df8-b167-c5e3e5885126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:38.015994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75102a7c-c4c0-4df8-b167-c5e3e5885126 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.016391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75102a7c-c4c0-4df8-b167-c5e3e5885126 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.016762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75102a7c-c4c0-4df8-b167-c5e3e5885126 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.017549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75102a7c-c4c0-4df8-b167-c5e3e5885126 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:38.017954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75102a7c-c4c0-4df8-b167-c5e3e5885126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:38.019448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75102a7c-c4c0-4df8-b167-c5e3e5885126 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:38.028849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 298/613] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:38.034563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85329d-432c-41c9-a8df-b84d8b697420 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:38.129594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:38.158597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75102a7c-c4c0-4df8-b167-c5e3e5885126 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:38.193913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85329d-432c-41c9-a8df-b84d8b697420 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:38.237790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bbb73-ccc8-45fb-9662-a8298023a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:38.238717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bbb73-ccc8-45fb-9662-a8298023a94e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.239880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bbb73-ccc8-45fb-9662-a8298023a94e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.240476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bbb73-ccc8-45fb-9662-a8298023a94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.259590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bbb73-ccc8-45fb-9662-a8298023a94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:38.261451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bbb73-ccc8-45fb-9662-a8298023a94e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-795bbb73-ccc8-45fb-9662-a8298023a94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:38.284673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:38.285761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:38.286736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:38.286736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:38.286736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:38.296606 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 316/614] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:38.303308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bbb73-ccc8-45fb-9662-a8298023a94e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:38.358441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75102a7c-c4c0-4df8-b167-c5e3e5885126 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:38.426196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bbb73-ccc8-45fb-9662-a8298023a94e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:38.439740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6960c28-a9bb-4ed3-9158-c8ab29cd4a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:38.440397 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6960c28-a9bb-4ed3-9158-c8ab29cd4a18 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.440683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6960c28-a9bb-4ed3-9158-c8ab29cd4a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.441030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6960c28-a9bb-4ed3-9158-c8ab29cd4a18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.442414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:38.467727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6960c28-a9bb-4ed3-9158-c8ab29cd4a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:38.475858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7b74c-40ba-4280-be00-40a44edaf791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:38.476688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7b74c-40ba-4280-be00-40a44edaf791 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.477124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7b74c-40ba-4280-be00-40a44edaf791 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.478066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7b74c-40ba-4280-be00-40a44edaf791 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.478881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7b74c-40ba-4280-be00-40a44edaf791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c6960c28-a9bb-4ed3-9158-c8ab29cd4a18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:38.479857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:38.481031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:38.482040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:38.483057 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7b74c-40ba-4280-be00-40a44edaf791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:38.484634 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7b74c-40ba-4280-be00-40a44edaf791 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:38.491913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 299/615] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:38.495088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6960c28-a9bb-4ed3-9158-c8ab29cd4a18 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:38.515278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 317/616] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:38.520954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7b74c-40ba-4280-be00-40a44edaf791 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:38.575753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:38.634678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6960c28-a9bb-4ed3-9158-c8ab29cd4a18 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:38.669789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb18bd-4d6b-42c7-904b-d5ed58056253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:38.670442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb18bd-4d6b-42c7-904b-d5ed58056253 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.670730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb18bd-4d6b-42c7-904b-d5ed58056253 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.671006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb18bd-4d6b-42c7-904b-d5ed58056253 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb18bd-4d6b-42c7-904b-d5ed58056253 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:38.671992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb18bd-4d6b-42c7-904b-d5ed58056253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:38.673365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb18bd-4d6b-42c7-904b-d5ed58056253 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:38.681984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 300/617] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:38.687739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb18bd-4d6b-42c7-904b-d5ed58056253 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:38.704866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7b74c-40ba-4280-be00-40a44edaf791 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:38.760233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c33cd-9b93-41e8-ab79-fd2b2b76bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:38.760876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c33cd-9b93-41e8-ab79-fd2b2b76bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.761155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c33cd-9b93-41e8-ab79-fd2b2b76bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.761429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c33cd-9b93-41e8-ab79-fd2b2b76bbb3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.778423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c33cd-9b93-41e8-ab79-fd2b2b76bbb3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:38.780090 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c33cd-9b93-41e8-ab79-fd2b2b76bbb3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6d7c33cd-9b93-41e8-ab79-fd2b2b76bbb3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:38.804200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:38.805192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:38.806846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:38.807465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 318/618] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:38.811854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c33cd-9b93-41e8-ab79-fd2b2b76bbb3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:38.870361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:38.884829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb18bd-4d6b-42c7-904b-d5ed58056253 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:38.898421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:38.960319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45df962-3b94-4c8a-aec9-461573ab6bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:38.960980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45df962-3b94-4c8a-aec9-461573ab6bcb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.961261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45df962-3b94-4c8a-aec9-461573ab6bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.961537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45df962-3b94-4c8a-aec9-461573ab6bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.981757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c33cd-9b93-41e8-ab79-fd2b2b76bbb3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:38.982659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45df962-3b94-4c8a-aec9-461573ab6bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:38.984325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45df962-3b94-4c8a-aec9-461573ab6bcb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b45df962-3b94-4c8a-aec9-461573ab6bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:39.011368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:39.012829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:39.013740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:39.013740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:39.013740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:39.015686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 301/619] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:39.021168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45df962-3b94-4c8a-aec9-461573ab6bcb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:39.032815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117b3d0-6650-4ae9-ab23-6d3aed0d5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.033743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b3d0-6650-4ae9-ab23-6d3aed0d5843 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.034334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b3d0-6650-4ae9-ab23-6d3aed0d5843 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.034816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117b3d0-6650-4ae9-ab23-6d3aed0d5843 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.036176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117b3d0-6650-4ae9-ab23-6d3aed0d5843 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:39.036686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117b3d0-6650-4ae9-ab23-6d3aed0d5843 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:39.038344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117b3d0-6650-4ae9-ab23-6d3aed0d5843 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.070738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 319/620] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 08:43:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:39.075599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c04fc6-f738-41a5-bf9d-82bd70c02e14 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.075896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c04fc6-f738-41a5-bf9d-82bd70c02e14 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.076344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c04fc6-f738-41a5-bf9d-82bd70c02e14 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.078476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 320/621] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:39.079263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c04fc6-f738-41a5-bf9d-82bd70c02e14 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:39.152461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45df962-3b94-4c8a-aec9-461573ab6bcb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:39.177704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:39.187911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7b3cd-34f5-4de6-8778-d16dff8590f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.188460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7b3cd-34f5-4de6-8778-d16dff8590f1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.188587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c04fc6-f738-41a5-bf9d-82bd70c02e14 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:39.188786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7b3cd-34f5-4de6-8778-d16dff8590f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.189015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7b3cd-34f5-4de6-8778-d16dff8590f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.189673 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7b3cd-34f5-4de6-8778-d16dff8590f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:39.189985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7b3cd-34f5-4de6-8778-d16dff8590f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:39.191477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7b3cd-34f5-4de6-8778-d16dff8590f1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.205053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 302/622] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:39.206694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27573fa-5ff2-49d7-a35d-715373c820b0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.206987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27573fa-5ff2-49d7-a35d-715373c820b0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.207265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27573fa-5ff2-49d7-a35d-715373c820b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.224980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa1ce9-cc39-4f8a-9b4f-eeca738445f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.225626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa1ce9-cc39-4f8a-9b4f-eeca738445f2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.225912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa1ce9-cc39-4f8a-9b4f-eeca738445f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.226235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa1ce9-cc39-4f8a-9b4f-eeca738445f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.228039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d27573fa-5ff2-49d7-a35d-715373c820b0 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:39.229716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d27573fa-5ff2-49d7-a35d-715373c820b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:39.237037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa1ce9-cc39-4f8a-9b4f-eeca738445f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:39.238532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa1ce9-cc39-4f8a-9b4f-eeca738445f2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.244213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8ffa1ce9-cc39-4f8a-9b4f-eeca738445f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:39.253498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:39.254723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:39.255969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:39.255969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:39.255969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:39.258206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 321/623] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:39.259776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa1ce9-cc39-4f8a-9b4f-eeca738445f2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:39.308239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 303/624] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:39.310008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27573fa-5ff2-49d7-a35d-715373c820b0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:39.401509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa1ce9-cc39-4f8a-9b4f-eeca738445f2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:39.417010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27573fa-5ff2-49d7-a35d-715373c820b0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:39.453303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006b2c-b83f-488b-8c14-dbad8876fccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.454291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006b2c-b83f-488b-8c14-dbad8876fccb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.454788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006b2c-b83f-488b-8c14-dbad8876fccb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.455281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006b2c-b83f-488b-8c14-dbad8876fccb None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.456135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c006b2c-b83f-488b-8c14-dbad8876fccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:39.456646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c006b2c-b83f-488b-8c14-dbad8876fccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:39.458260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c006b2c-b83f-488b-8c14-dbad8876fccb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.471563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 304/625] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:39.473463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306acf0-2a6a-4f31-bb0e-0ab7163863bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.474128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306acf0-2a6a-4f31-bb0e-0ab7163863bd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.474412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306acf0-2a6a-4f31-bb0e-0ab7163863bd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.474681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306acf0-2a6a-4f31-bb0e-0ab7163863bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.476732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006b2c-b83f-488b-8c14-dbad8876fccb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:39.497263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306acf0-2a6a-4f31-bb0e-0ab7163863bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:39.499115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306acf0-2a6a-4f31-bb0e-0ab7163863bd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.503598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b306acf0-2a6a-4f31-bb0e-0ab7163863bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:39.523349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:39.528973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:39.529933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:39.533463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 322/626] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:39.537590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306acf0-2a6a-4f31-bb0e-0ab7163863bd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:39.543331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:39.649887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006b2c-b83f-488b-8c14-dbad8876fccb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:39.703039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb813a5-0d1f-49c0-8aee-0f5e80e9e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.704122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb813a5-0d1f-49c0-8aee-0f5e80e9e74d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.704626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb813a5-0d1f-49c0-8aee-0f5e80e9e74d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.705103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb813a5-0d1f-49c0-8aee-0f5e80e9e74d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.712767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb813a5-0d1f-49c0-8aee-0f5e80e9e74d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:39.714624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb813a5-0d1f-49c0-8aee-0f5e80e9e74d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.718984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306acf0-2a6a-4f31-bb0e-0ab7163863bd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ddb813a5-0d1f-49c0-8aee-0f5e80e9e74d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:39.727677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:39.728605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:39.729747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:39.729747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:39.729747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:39.729747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:39.729747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:39.729747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:39.729747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:39.729747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:39.733338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 305/627] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:39.735000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb813a5-0d1f-49c0-8aee-0f5e80e9e74d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:39.761076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396517-6be5-45c6-b89e-0a5c760b4252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.761696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396517-6be5-45c6-b89e-0a5c760b4252 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.761982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396517-6be5-45c6-b89e-0a5c760b4252 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.762281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396517-6be5-45c6-b89e-0a5c760b4252 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.763018 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06396517-6be5-45c6-b89e-0a5c760b4252 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:39.763347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06396517-6be5-45c6-b89e-0a5c760b4252 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:39.764883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06396517-6be5-45c6-b89e-0a5c760b4252 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.783030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 323/628] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:39.784221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396517-6be5-45c6-b89e-0a5c760b4252 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:39.812037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:39.845593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:39.853949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb813a5-0d1f-49c0-8aee-0f5e80e9e74d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:39.888505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396517-6be5-45c6-b89e-0a5c760b4252 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:39.892442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b8ea5-8da5-42ac-a747-ce835ac80194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.893352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b8ea5-8da5-42ac-a747-ce835ac80194 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.893913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b8ea5-8da5-42ac-a747-ce835ac80194 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.894420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b8ea5-8da5-42ac-a747-ce835ac80194 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.906044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b8ea5-8da5-42ac-a747-ce835ac80194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-570b8ea5-8da5-42ac-a747-ce835ac80194 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:39.912133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:39.913089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:39.913949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:39.918411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 306/629] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:39.919480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b8ea5-8da5-42ac-a747-ce835ac80194 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:39.933933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c113c3-7f91-4363-871e-bf2141844aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.934587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c113c3-7f91-4363-871e-bf2141844aea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.934873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c113c3-7f91-4363-871e-bf2141844aea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.935172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c113c3-7f91-4363-871e-bf2141844aea None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.937636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c113c3-7f91-4363-871e-bf2141844aea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:39.937894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c113c3-7f91-4363-871e-bf2141844aea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:39.939407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c113c3-7f91-4363-871e-bf2141844aea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.957435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 324/630] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:39.958279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c113c3-7f91-4363-871e-bf2141844aea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:40.036566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b8ea5-8da5-42ac-a747-ce835ac80194 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:40.067339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c113c3-7f91-4363-871e-bf2141844aea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:40.069275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:40.079847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330d87c-8b01-4633-9011-bc1373caee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:40.086934 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d87c-8b01-4633-9011-bc1373caee63 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.086934 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d87c-8b01-4633-9011-bc1373caee63 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.086934 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d87c-8b01-4633-9011-bc1373caee63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.101170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:40.106852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82d38f-5a87-4f12-9590-c1905a980429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:40.107494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82d38f-5a87-4f12-9590-c1905a980429 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.107789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82d38f-5a87-4f12-9590-c1905a980429 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.108066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82d38f-5a87-4f12-9590-c1905a980429 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.108751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82d38f-5a87-4f12-9590-c1905a980429 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:40.109061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82d38f-5a87-4f12-9590-c1905a980429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:40.110537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82d38f-5a87-4f12-9590-c1905a980429 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:40.123892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 325/631] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:40.124750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82d38f-5a87-4f12-9590-c1905a980429 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:40.156910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330d87c-8b01-4633-9011-bc1373caee63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:40.158744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330d87c-8b01-4633-9011-bc1373caee63 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:40.226509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82d38f-5a87-4f12-9590-c1905a980429 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:40.257869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 307/632] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:40.259256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670811-4fcf-4cbe-879b-4c937a5ed111 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.259549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670811-4fcf-4cbe-879b-4c937a5ed111 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.259680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81472698-d82c-4a5c-97a0-8f01bcfdc045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:40.259903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670811-4fcf-4cbe-879b-4c937a5ed111 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.260250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472698-d82c-4a5c-97a0-8f01bcfdc045 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.260530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472698-d82c-4a5c-97a0-8f01bcfdc045 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.260804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472698-d82c-4a5c-97a0-8f01bcfdc045 None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/88353e858ec64a9cbdcfd16dbc00ebe3/roles/a53d956761a64b18a7d7e76cbef98222` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.262127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 308/633] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:40.262127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db670811-4fcf-4cbe-879b-4c937a5ed111 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:40.277283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81472698-d82c-4a5c-97a0-8f01bcfdc045 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=88353e858ec64a9cbdcfd16dbc00ebe3, role_id=a53d956761a64b18a7d7e76cbef98222)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:40.278768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81472698-d82c-4a5c-97a0-8f01bcfdc045 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:40.288966 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:40.351757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 326/634] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:43:40 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/88353e858ec64a9cbdcfd16dbc00ebe3/roles/a53d956761a64b18a7d7e76cbef98222 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:40.353666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc748-e43a-4151-8099-99c491169de3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.353952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc748-e43a-4151-8099-99c491169de3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.354259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cc748-e43a-4151-8099-99c491169de3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.355778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 327/635] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:40.359352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db670811-4fcf-4cbe-879b-4c937a5ed111 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:40.360861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cc748-e43a-4151-8099-99c491169de3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:40.395075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:40.403572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280a8f-01a4-41a0-b6ea-64e399f246ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:40.404884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280a8f-01a4-41a0-b6ea-64e399f246ad None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.404884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280a8f-01a4-41a0-b6ea-64e399f246ad None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.404884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280a8f-01a4-41a0-b6ea-64e399f246ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.417494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280a8f-01a4-41a0-b6ea-64e399f246ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:40.419018 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280a8f-01a4-41a0-b6ea-64e399f246ad None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ba280a8f-01a4-41a0-b6ea-64e399f246ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:40.435820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:40.436972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:40.437875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:40.437875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:40.437875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:40.437875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 309/636] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:40.438739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153616b-f776-4c91-a9a1-dcab945bed26 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.438901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153616b-f776-4c91-a9a1-dcab945bed26 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.439178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153616b-f776-4c91-a9a1-dcab945bed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.459059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1153616b-f776-4c91-a9a1-dcab945bed26 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:40.460554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1153616b-f776-4c91-a9a1-dcab945bed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:40.478889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cc748-e43a-4151-8099-99c491169de3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:40.516688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94a30a-3c39-4236-bbf2-befddde8173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:40.517329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94a30a-3c39-4236-bbf2-befddde8173f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.517609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94a30a-3c39-4236-bbf2-befddde8173f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.517905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94a30a-3c39-4236-bbf2-befddde8173f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.532313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94a30a-3c39-4236-bbf2-befddde8173f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:40.534158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94a30a-3c39-4236-bbf2-befddde8173f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:40.536424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 310/637] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:40.537509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce87d04-ec09-410c-aec9-2c3ee193c9b3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.537796 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce87d04-ec09-410c-aec9-2c3ee193c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.538068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce87d04-ec09-410c-aec9-2c3ee193c9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5a94a30a-3c39-4236-bbf2-befddde8173f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:40.551066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:40.552052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:40.552937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:40.552937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:40.552937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:40.552937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 328/638] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:40.552937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94a30a-3c39-4236-bbf2-befddde8173f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:40.565461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4ce87d04-ec09-410c-aec9-2c3ee193c9b3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:40.566670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4ce87d04-ec09-410c-aec9-2c3ee193c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:40.575435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:40.646815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 311/639] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:40.647840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce87d04-ec09-410c-aec9-2c3ee193c9b3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:40.648306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:40.682691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94a30a-3c39-4236-bbf2-befddde8173f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:40.747067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e734b55-f7c1-454a-b65b-fda20f2665fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:40.747602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734b55-f7c1-454a-b65b-fda20f2665fc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.747883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734b55-f7c1-454a-b65b-fda20f2665fc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.748156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e734b55-f7c1-454a-b65b-fda20f2665fc None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.748806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e734b55-f7c1-454a-b65b-fda20f2665fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:40.749112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e734b55-f7c1-454a-b65b-fda20f2665fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:40.750519 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e734b55-f7c1-454a-b65b-fda20f2665fc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:40.769272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 329/640] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:40.775087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e734b55-f7c1-454a-b65b-fda20f2665fc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:40.839726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce87d04-ec09-410c-aec9-2c3ee193c9b3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:40.879654 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a24d1-ad54-4890-b9b1-45129ac657aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:40.880393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a24d1-ad54-4890-b9b1-45129ac657aa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.880677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a24d1-ad54-4890-b9b1-45129ac657aa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.880952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a24d1-ad54-4890-b9b1-45129ac657aa None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.881611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a24d1-ad54-4890-b9b1-45129ac657aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:40.881918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a24d1-ad54-4890-b9b1-45129ac657aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:40.884151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a24d1-ad54-4890-b9b1-45129ac657aa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:40.895148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:40.899052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 312/641] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:40.900950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a24d1-ad54-4890-b9b1-45129ac657aa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:40.909716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e734b55-f7c1-454a-b65b-fda20f2665fc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:40.963612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f95d27-df7c-4f39-8d3c-c913707ec2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:40.964277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f95d27-df7c-4f39-8d3c-c913707ec2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:40.964553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f95d27-df7c-4f39-8d3c-c913707ec2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:40.964821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f95d27-df7c-4f39-8d3c-c913707ec2e9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:40.971908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f95d27-df7c-4f39-8d3c-c913707ec2e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:40.973341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f95d27-df7c-4f39-8d3c-c913707ec2e9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f4f95d27-df7c-4f39-8d3c-c913707ec2e9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:40.985061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:40.986208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 330/642] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:40.987155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f95d27-df7c-4f39-8d3c-c913707ec2e9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:40.991613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.018289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a24d1-ad54-4890-b9b1-45129ac657aa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.057088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e33053-23af-42a2-817e-003088c425e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.058659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e33053-23af-42a2-817e-003088c425e9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.059012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e33053-23af-42a2-817e-003088c425e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.059288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e33053-23af-42a2-817e-003088c425e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.069947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e33053-23af-42a2-817e-003088c425e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e7e33053-23af-42a2-817e-003088c425e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:41.076075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:41.077083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:41.077936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 313/643] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:41.078655 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e33053-23af-42a2-817e-003088c425e9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.093563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f95d27-df7c-4f39-8d3c-c913707ec2e9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.127260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ede41-50db-44ee-88de-2ae0226a7f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.127889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ede41-50db-44ee-88de-2ae0226a7f37 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.128170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ede41-50db-44ee-88de-2ae0226a7f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.128444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ede41-50db-44ee-88de-2ae0226a7f37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.135755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ede41-50db-44ee-88de-2ae0226a7f37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:41.137241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ede41-50db-44ee-88de-2ae0226a7f37 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:41.140226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cb0ede41-50db-44ee-88de-2ae0226a7f37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:41.148694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:41.155611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 331/644] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:41.156699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ede41-50db-44ee-88de-2ae0226a7f37 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.186839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e33053-23af-42a2-817e-003088c425e9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.218562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.220795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a874c47-d721-4dfc-a99e-b3def8ee4871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.221424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a874c47-d721-4dfc-a99e-b3def8ee4871 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.221704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a874c47-d721-4dfc-a99e-b3def8ee4871 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.221974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a874c47-d721-4dfc-a99e-b3def8ee4871 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.232419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a874c47-d721-4dfc-a99e-b3def8ee4871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2a874c47-d721-4dfc-a99e-b3def8ee4871 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:41.238702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:41.239653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:41.240504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 314/645] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:41.241186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a874c47-d721-4dfc-a99e-b3def8ee4871 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.266035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ede41-50db-44ee-88de-2ae0226a7f37 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.300690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e82315-d231-411e-b3db-161da1e2c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.301229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e82315-d231-411e-b3db-161da1e2c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.301497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e82315-d231-411e-b3db-161da1e2c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.301769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e82315-d231-411e-b3db-161da1e2c1d1 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.302544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e82315-d231-411e-b3db-161da1e2c1d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:41.302849 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e82315-d231-411e-b3db-161da1e2c1d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:41.304334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e82315-d231-411e-b3db-161da1e2c1d1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:41.329219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 332/646] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:41.329219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e82315-d231-411e-b3db-161da1e2c1d1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.347331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a874c47-d721-4dfc-a99e-b3def8ee4871 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.369803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.384044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db85a7-fb4b-45dd-aab7-1a874ecb272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.384690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db85a7-fb4b-45dd-aab7-1a874ecb272e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.384950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db85a7-fb4b-45dd-aab7-1a874ecb272e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.385222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db85a7-fb4b-45dd-aab7-1a874ecb272e None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.385925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db85a7-fb4b-45dd-aab7-1a874ecb272e None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:41.386207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db85a7-fb4b-45dd-aab7-1a874ecb272e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:41.387576 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db85a7-fb4b-45dd-aab7-1a874ecb272e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:41.400347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 315/647] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:41.400347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db85a7-fb4b-45dd-aab7-1a874ecb272e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.441708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e82315-d231-411e-b3db-161da1e2c1d1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.466137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.478150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86145a-7adf-48dd-9006-7591d3ccf84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.478876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86145a-7adf-48dd-9006-7591d3ccf84e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.479736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86145a-7adf-48dd-9006-7591d3ccf84e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.479736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86145a-7adf-48dd-9006-7591d3ccf84e None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.480373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86145a-7adf-48dd-9006-7591d3ccf84e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:41.480680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86145a-7adf-48dd-9006-7591d3ccf84e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:41.482132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86145a-7adf-48dd-9006-7591d3ccf84e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:41.498069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 333/648] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:41.498069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86145a-7adf-48dd-9006-7591d3ccf84e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.511405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db85a7-fb4b-45dd-aab7-1a874ecb272e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.546690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2416fd-fa4c-4f3f-a03f-6a5089489da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.547300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2416fd-fa4c-4f3f-a03f-6a5089489da7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.547588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2416fd-fa4c-4f3f-a03f-6a5089489da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.547865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2416fd-fa4c-4f3f-a03f-6a5089489da7 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.548539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2416fd-fa4c-4f3f-a03f-6a5089489da7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:41.548847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2416fd-fa4c-4f3f-a03f-6a5089489da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:41.550277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2416fd-fa4c-4f3f-a03f-6a5089489da7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:41.558266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 316/649] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:41.558839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2416fd-fa4c-4f3f-a03f-6a5089489da7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.609727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.610440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86145a-7adf-48dd-9006-7591d3ccf84e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.645465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939ee0e-77dd-4a48-a330-16d15b55efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.646098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939ee0e-77dd-4a48-a330-16d15b55efc5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.646383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939ee0e-77dd-4a48-a330-16d15b55efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.646950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939ee0e-77dd-4a48-a330-16d15b55efc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.667331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2416fd-fa4c-4f3f-a03f-6a5089489da7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.697114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.702907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b14054-654a-4f1a-a562-4f83c9f47815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.703544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14054-654a-4f1a-a562-4f83c9f47815 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.703823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14054-654a-4f1a-a562-4f83c9f47815 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.704097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b14054-654a-4f1a-a562-4f83c9f47815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.715320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b14054-654a-4f1a-a562-4f83c9f47815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:41.715884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939ee0e-77dd-4a48-a330-16d15b55efc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:41.716803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b14054-654a-4f1a-a562-4f83c9f47815 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:41.717390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939ee0e-77dd-4a48-a330-16d15b55efc5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-20b14054-654a-4f1a-a562-4f83c9f47815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:41.731504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:41.732476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:41.733352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:41.733352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:41.733352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:41.733352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 317/650] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:41.733352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b14054-654a-4f1a-a562-4f83c9f47815 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.822231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 334/651] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:41.823408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939ee0e-77dd-4a48-a330-16d15b55efc5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.845665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.852932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b14054-654a-4f1a-a562-4f83c9f47815 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.895127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fa999-edcf-4203-9188-8fa71e30e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.895792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fa999-edcf-4203-9188-8fa71e30e029 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.896072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fa999-edcf-4203-9188-8fa71e30e029 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.896344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fa999-edcf-4203-9188-8fa71e30e029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.897090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fa999-edcf-4203-9188-8fa71e30e029 None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=9f31f738fe094e4ea7ed440e661e2111) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:41.897485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fa999-edcf-4203-9188-8fa71e30e029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:41.898944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fa999-edcf-4203-9188-8fa71e30e029 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:41.905286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.912636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 318/652] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/role_assignments?user.id=9f31f738fe094e4ea7ed440e661e2111&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:41.912636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fa999-edcf-4203-9188-8fa71e30e029 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.941119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939ee0e-77dd-4a48-a330-16d15b55efc5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:41.986429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4fc71-09a5-4c55-ab4b-c14569569c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:41.987331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4fc71-09a5-4c55-ab4b-c14569569c3a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.987818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4fc71-09a5-4c55-ab4b-c14569569c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.988264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4fc71-09a5-4c55-ab4b-c14569569c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.000318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4fc71-09a5-4c55-ab4b-c14569569c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.002230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4fc71-09a5-4c55-ab4b-c14569569c3a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e7c4fc71-09a5-4c55-ab4b-c14569569c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:42.020552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:42.021555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:42.022585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:42.022585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:42.022585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:42.029011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 335/653] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:42.030304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4fc71-09a5-4c55-ab4b-c14569569c3a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:42.033814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fa999-edcf-4203-9188-8fa71e30e029 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.077481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93f858-4f3f-4770-ac83-36082eaec395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.078943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93f858-4f3f-4770-ac83-36082eaec395 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.079421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93f858-4f3f-4770-ac83-36082eaec395 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.079834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93f858-4f3f-4770-ac83-36082eaec395 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.080745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93f858-4f3f-4770-ac83-36082eaec395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:42.081212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93f858-4f3f-4770-ac83-36082eaec395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.082856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93f858-4f3f-4770-ac83-36082eaec395 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.096177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 319/654] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:42.097469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93f858-4f3f-4770-ac83-36082eaec395 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:42.128519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:42.165265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4fc71-09a5-4c55-ab4b-c14569569c3a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.205451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100324-a8fc-449b-ba2f-166d8c8005ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.206270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100324-a8fc-449b-ba2f-166d8c8005ae None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.206652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100324-a8fc-449b-ba2f-166d8c8005ae None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.207139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100324-a8fc-449b-ba2f-166d8c8005ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.209465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:42.219964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27100324-a8fc-449b-ba2f-166d8c8005ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.221829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27100324-a8fc-449b-ba2f-166d8c8005ae None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.231697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93f858-4f3f-4770-ac83-36082eaec395 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-27100324-a8fc-449b-ba2f-166d8c8005ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:42.240201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:42.241192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:42.242146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:42.242146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:42.242146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:42.246211 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 336/655] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:42.247211 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100324-a8fc-449b-ba2f-166d8c8005ae None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:42.273169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc349b19-5c20-4c83-806c-f8baf469952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.273962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc349b19-5c20-4c83-806c-f8baf469952e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.274898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc349b19-5c20-4c83-806c-f8baf469952e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.275270 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc349b19-5c20-4c83-806c-f8baf469952e None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.276024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc349b19-5c20-4c83-806c-f8baf469952e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:42.276538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc349b19-5c20-4c83-806c-f8baf469952e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.278122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc349b19-5c20-4c83-806c-f8baf469952e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.290773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 320/656] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:42.291887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc349b19-5c20-4c83-806c-f8baf469952e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:42.373608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100324-a8fc-449b-ba2f-166d8c8005ae None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.387665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:42.408347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc349b19-5c20-4c83-806c-f8baf469952e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.418411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219271c4-92e7-47e0-974f-18bda09c1bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.419630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219271c4-92e7-47e0-974f-18bda09c1bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.420057 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219271c4-92e7-47e0-974f-18bda09c1bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.420786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219271c4-92e7-47e0-974f-18bda09c1bd2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.431942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219271c4-92e7-47e0-974f-18bda09c1bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.433910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219271c4-92e7-47e0-974f-18bda09c1bd2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.447216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526b5e9-88ca-4b76-bdf1-81fd3d2f9f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.448017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526b5e9-88ca-4b76-bdf1-81fd3d2f9f75 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.448391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526b5e9-88ca-4b76-bdf1-81fd3d2f9f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.448800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526b5e9-88ca-4b76-bdf1-81fd3d2f9f75 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-219271c4-92e7-47e0-974f-18bda09c1bd2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:42.449469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:42.450549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:43:42.451671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:42.452323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526b5e9-88ca-4b76-bdf1-81fd3d2f9f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:42.452474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526b5e9-88ca-4b76-bdf1-81fd3d2f9f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.453959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526b5e9-88ca-4b76-bdf1-81fd3d2f9f75 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.454133 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 337/657] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:42.455106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219271c4-92e7-47e0-974f-18bda09c1bd2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:42.473578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 321/658] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:42.478829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526b5e9-88ca-4b76-bdf1-81fd3d2f9f75 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:42.517977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:42.579991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219271c4-92e7-47e0-974f-18bda09c1bd2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.612312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526b5e9-88ca-4b76-bdf1-81fd3d2f9f75 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.619055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6445a1c-9b14-4488-9aad-39889efab2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.619693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6445a1c-9b14-4488-9aad-39889efab2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.619945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6445a1c-9b14-4488-9aad-39889efab2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.620217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6445a1c-9b14-4488-9aad-39889efab2a9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.627752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6445a1c-9b14-4488-9aad-39889efab2a9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.629178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6445a1c-9b14-4488-9aad-39889efab2a9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d6445a1c-9b14-4488-9aad-39889efab2a9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:42.640295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:42.641222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 338/659] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:42.642768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6445a1c-9b14-4488-9aad-39889efab2a9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:42.653483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d1507-1cc5-46be-a1b1-8aadaa7fdaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.653807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1507-1cc5-46be-a1b1-8aadaa7fdaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.654113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1507-1cc5-46be-a1b1-8aadaa7fdaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.654387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1507-1cc5-46be-a1b1-8aadaa7fdaa1 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.655133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d1507-1cc5-46be-a1b1-8aadaa7fdaa1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:42.655442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d1507-1cc5-46be-a1b1-8aadaa7fdaa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.656863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d1507-1cc5-46be-a1b1-8aadaa7fdaa1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.668039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:42.676585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 322/660] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Oct 4 08:43:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:42.677774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45928e6f-9e19-4c41-83f6-cf577f6e6ddd None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.678058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45928e6f-9e19-4c41-83f6-cf577f6e6ddd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.682594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45928e6f-9e19-4c41-83f6-cf577f6e6ddd None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.682594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 323/661] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:42.682594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45928e6f-9e19-4c41-83f6-cf577f6e6ddd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:42.754564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6445a1c-9b14-4488-9aad-39889efab2a9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.762490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:42.786983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45928e6f-9e19-4c41-83f6-cf577f6e6ddd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.790980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5512f-5e7f-48db-820c-5f49a7e22422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.791711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5512f-5e7f-48db-820c-5f49a7e22422 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.792422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5512f-5e7f-48db-820c-5f49a7e22422 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.793072 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5512f-5e7f-48db-820c-5f49a7e22422 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.800603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5512f-5e7f-48db-820c-5f49a7e22422 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.803063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5512f-5e7f-48db-820c-5f49a7e22422 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.823907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafad16-d52c-47ca-94e8-30c1c69c09dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.824549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafad16-d52c-47ca-94e8-30c1c69c09dd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.824835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafad16-d52c-47ca-94e8-30c1c69c09dd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.825114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafad16-d52c-47ca-94e8-30c1c69c09dd None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.825879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafad16-d52c-47ca-94e8-30c1c69c09dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:42.826218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafad16-d52c-47ca-94e8-30c1c69c09dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.827771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafad16-d52c-47ca-94e8-30c1c69c09dd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.854788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 324/662] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Oct 4 08:43:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:42.854788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafad16-d52c-47ca-94e8-30c1c69c09dd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:42.914006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f7d5512f-5e7f-48db-820c-5f49a7e22422 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:42.926302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:42.927250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:42.928150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:42.928150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:42.928150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:42.928150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:42.928150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:42.928150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:42.928150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:42.928150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:42.928150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 339/663] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:42.928635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f76cbb-dcf0-466c-8438-42f19bbf695f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.929185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f76cbb-dcf0-466c-8438-42f19bbf695f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.929185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f76cbb-dcf0-466c-8438-42f19bbf695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.950872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-74f76cbb-dcf0-466c-8438-42f19bbf695f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:42.952383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-74f76cbb-dcf0-466c-8438-42f19bbf695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:42.967910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafad16-d52c-47ca-94e8-30c1c69c09dd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:43.004765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc2aa2-9b86-49f3-b414-fcbe3892d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:43.005378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc2aa2-9b86-49f3-b414-fcbe3892d682 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:43.005662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc2aa2-9b86-49f3-b414-fcbe3892d682 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:43.005940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc2aa2-9b86-49f3-b414-fcbe3892d682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:43.028407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 340/664] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:43.029496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f76cbb-dcf0-466c-8438-42f19bbf695f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:43.085413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc2aa2-9b86-49f3-b414-fcbe3892d682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:43.087483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc2aa2-9b86-49f3-b414-fcbe3892d682 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:43.150840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:43.156291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:43.164209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f76cbb-dcf0-466c-8438-42f19bbf695f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:43.205835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284783b1-9164-4759-89af-695332ba8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:43.207289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284783b1-9164-4759-89af-695332ba8531 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:43.207792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284783b1-9164-4759-89af-695332ba8531 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:43.208266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284783b1-9164-4759-89af-695332ba8531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:43.210939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 325/665] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:43.212751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc2aa2-9b86-49f3-b414-fcbe3892d682 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:43.296137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284783b1-9164-4759-89af-695332ba8531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:43.297590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284783b1-9164-4759-89af-695332ba8531 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:43.333552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc2aa2-9b86-49f3-b414-fcbe3892d682 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:43.369688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4343-ef30-40cf-838e-16dbb201bffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:43.370621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4343-ef30-40cf-838e-16dbb201bffa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:43.370911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4343-ef30-40cf-838e-16dbb201bffa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:43.371186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e4343-ef30-40cf-838e-16dbb201bffa None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:43.371884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e4343-ef30-40cf-838e-16dbb201bffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:43.372195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e4343-ef30-40cf-838e-16dbb201bffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:43.373636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e4343-ef30-40cf-838e-16dbb201bffa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:43.390370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 326/666] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:43.390370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4343-ef30-40cf-838e-16dbb201bffa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:43.397348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:43.404747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 341/667] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:43.414494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:43.414673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284783b1-9164-4759-89af-695332ba8531 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:43.492188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e4343-ef30-40cf-838e-16dbb201bffa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:43.515979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284783b1-9164-4759-89af-695332ba8531 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:43.527237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9892a-8e30-4767-bd05-4df92ef54fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:43.527864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9892a-8e30-4767-bd05-4df92ef54fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:43.528152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9892a-8e30-4767-bd05-4df92ef54fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:43.528428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9892a-8e30-4767-bd05-4df92ef54fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:43.539100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9892a-8e30-4767-bd05-4df92ef54fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:43.541117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9892a-8e30-4767-bd05-4df92ef54fa0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:43.551654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323afc7-bdc8-42bc-bf3c-a1eaada870a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:43.552273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323afc7-bdc8-42bc-bf3c-a1eaada870a1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:43.552549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323afc7-bdc8-42bc-bf3c-a1eaada870a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:43.552816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323afc7-bdc8-42bc-bf3c-a1eaada870a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9ec9892a-8e30-4767-bd05-4df92ef54fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:43.555407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:43.556319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:43.557203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:43.557203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:43.557203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:43.557203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 327/668] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:43.557432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9892a-8e30-4767-bd05-4df92ef54fa0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:43.567579 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323afc7-bdc8-42bc-bf3c-a1eaada870a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7323afc7-bdc8-42bc-bf3c-a1eaada870a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:43.572438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:43.573359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 342/669] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:43.574563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323afc7-bdc8-42bc-bf3c-a1eaada870a1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:43.630646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:43.635139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:43.670720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9892a-8e30-4767-bd05-4df92ef54fa0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:43.676981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323afc7-bdc8-42bc-bf3c-a1eaada870a1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:43.706244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d2456-f940-4fa4-9db6-98407ebb5fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:43.707033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d2456-f940-4fa4-9db6-98407ebb5fcb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:43.707157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d2456-f940-4fa4-9db6-98407ebb5fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:43.707398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d2456-f940-4fa4-9db6-98407ebb5fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:43.708127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d2456-f940-4fa4-9db6-98407ebb5fcb None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=8a8339b6461e4e28bc397dcd3f85e1a3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:43.708445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d2456-f940-4fa4-9db6-98407ebb5fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:43.710008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d2456-f940-4fa4-9db6-98407ebb5fcb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:43.712768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49f215-0506-424b-b278-d22efd632f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:43.713502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49f215-0506-424b-b278-d22efd632f17 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:43.713844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49f215-0506-424b-b278-d22efd632f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:43.714147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49f215-0506-424b-b278-d22efd632f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:43.717029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 328/670] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/role_assignments?user.id=8a8339b6461e4e28bc397dcd3f85e1a3&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:43.718014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d2456-f940-4fa4-9db6-98407ebb5fcb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:43.733847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49f215-0506-424b-b278-d22efd632f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:43.735425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49f215-0506-424b-b278-d22efd632f17 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dc49f215-0506-424b-b278-d22efd632f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:43.756569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:43.757572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:43.759054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:43.759054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:43.759054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:43.759054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 343/671] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:43.759938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49f215-0506-424b-b278-d22efd632f17 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:43.859797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d2456-f940-4fa4-9db6-98407ebb5fcb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:43.879483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49f215-0506-424b-b278-d22efd632f17 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:43.890797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:43.899194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:43.905843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778052d-8ce3-4436-a95c-61094feb6b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:43.906841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778052d-8ce3-4436-a95c-61094feb6b9b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:43.907411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778052d-8ce3-4436-a95c-61094feb6b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:43.907901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778052d-8ce3-4436-a95c-61094feb6b9b None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:43.908756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778052d-8ce3-4436-a95c-61094feb6b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:43.909132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778052d-8ce3-4436-a95c-61094feb6b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:43.910625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778052d-8ce3-4436-a95c-61094feb6b9b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:43.921464 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cc12d-59e8-472b-bffb-7f225f48a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:43.922368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cc12d-59e8-472b-bffb-7f225f48a037 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:43.923802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cc12d-59e8-472b-bffb-7f225f48a037 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:43.923922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 329/672] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:43.924338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cc12d-59e8-472b-bffb-7f225f48a037 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:43.924474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778052d-8ce3-4436-a95c-61094feb6b9b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:43.925319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cc12d-59e8-472b-bffb-7f225f48a037 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:43.925782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cc12d-59e8-472b-bffb-7f225f48a037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:43.930690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cc12d-59e8-472b-bffb-7f225f48a037 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:43.942401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 344/673] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:43.943452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cc12d-59e8-472b-bffb-7f225f48a037 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:44.064345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cc12d-59e8-472b-bffb-7f225f48a037 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:44.067774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778052d-8ce3-4436-a95c-61094feb6b9b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:44.102701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8d12-b427-410f-951d-be49a00d9b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:44.103800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8d12-b427-410f-951d-be49a00d9b81 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.104609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8d12-b427-410f-951d-be49a00d9b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.105038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8d12-b427-410f-951d-be49a00d9b81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.106842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aabce2-b5de-41f6-9996-002bb4cba536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:44.107554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aabce2-b5de-41f6-9996-002bb4cba536 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.107938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aabce2-b5de-41f6-9996-002bb4cba536 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.108313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aabce2-b5de-41f6-9996-002bb4cba536 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.109233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aabce2-b5de-41f6-9996-002bb4cba536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:44.109457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aabce2-b5de-41f6-9996-002bb4cba536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:44.110957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aabce2-b5de-41f6-9996-002bb4cba536 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:44.114170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c8d12-b427-410f-951d-be49a00d9b81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:44.115868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c8d12-b427-410f-951d-be49a00d9b81 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7c9c8d12-b427-410f-951d-be49a00d9b81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:44.129069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:44.130218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:44.131194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:44.131194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:44.131194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:44.131194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:44.131194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:44.131194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:44.131194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:44.131194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:44.131630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 330/674] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:44.131630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aabce2-b5de-41f6-9996-002bb4cba536 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:44.133507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 345/675] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:44.135153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8d12-b427-410f-951d-be49a00d9b81 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:44.171724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:44.198532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:44.247704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8d12-b427-410f-951d-be49a00d9b81 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:44.253623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aabce2-b5de-41f6-9996-002bb4cba536 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:44.284604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68765e74-f70e-4fef-ad6d-545d6a03981d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:44.285259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68765e74-f70e-4fef-ad6d-545d6a03981d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.285526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68765e74-f70e-4fef-ad6d-545d6a03981d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.285799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68765e74-f70e-4fef-ad6d-545d6a03981d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.292494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86206eb3-be6e-4023-88fe-83575a228cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:44.292646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68765e74-f70e-4fef-ad6d-545d6a03981d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:44.293459 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86206eb3-be6e-4023-88fe-83575a228cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.293925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86206eb3-be6e-4023-88fe-83575a228cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.294118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68765e74-f70e-4fef-ad6d-545d6a03981d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:44.294566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86206eb3-be6e-4023-88fe-83575a228cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-68765e74-f70e-4fef-ad6d-545d6a03981d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:44.305905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:44.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:44.307890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:44.307890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:44.307890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:44.307890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:44.307890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:44.307890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:44.307890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:44.307890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:44.307890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 346/676] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:44.308423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68765e74-f70e-4fef-ad6d-545d6a03981d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:44.309055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86206eb3-be6e-4023-88fe-83575a228cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:44.310713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86206eb3-be6e-4023-88fe-83575a228cd0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-86206eb3-be6e-4023-88fe-83575a228cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:44.328079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:44.329068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:44.329948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:44.329948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:44.329948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:44.329948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 331/677] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:44.330627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec183d1f-8a38-453e-a1cb-f27875f014f9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.330724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec183d1f-8a38-453e-a1cb-f27875f014f9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.331150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec183d1f-8a38-453e-a1cb-f27875f014f9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.334210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 332/678] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:44.334210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec183d1f-8a38-453e-a1cb-f27875f014f9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:44.413503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:44.425160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68765e74-f70e-4fef-ad6d-545d6a03981d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:44.441564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec183d1f-8a38-453e-a1cb-f27875f014f9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:44.443940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:44.465124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b04dd0-01ed-467f-8a71-f4c8ed5ea329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:44.465992 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b04dd0-01ed-467f-8a71-f4c8ed5ea329 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.466480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b04dd0-01ed-467f-8a71-f4c8ed5ea329 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.466840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b04dd0-01ed-467f-8a71-f4c8ed5ea329 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.467452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b04dd0-01ed-467f-8a71-f4c8ed5ea329 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:44.467759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b04dd0-01ed-467f-8a71-f4c8ed5ea329 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:44.469216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b04dd0-01ed-467f-8a71-f4c8ed5ea329 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:44.476514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e88e8-719a-4ece-a8f2-ff53e3a137d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:44.477256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e88e8-719a-4ece-a8f2-ff53e3a137d1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.477604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e88e8-719a-4ece-a8f2-ff53e3a137d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.477943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e88e8-719a-4ece-a8f2-ff53e3a137d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.478733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e88e8-719a-4ece-a8f2-ff53e3a137d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:44.479106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e88e8-719a-4ece-a8f2-ff53e3a137d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:44.480930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e88e8-719a-4ece-a8f2-ff53e3a137d1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:44.481809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 347/679] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:44.487219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b04dd0-01ed-467f-8a71-f4c8ed5ea329 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:44.493552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 333/680] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:44.495187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb956997-cdf2-495b-963e-228d41bbeddb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.495584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb956997-cdf2-495b-963e-228d41bbeddb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.495959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb956997-cdf2-495b-963e-228d41bbeddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.516034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cb956997-cdf2-495b-963e-228d41bbeddb None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:44.517577 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cb956997-cdf2-495b-963e-228d41bbeddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:44.589541 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 334/681] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:44.590653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb956997-cdf2-495b-963e-228d41bbeddb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:44.607933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b04dd0-01ed-467f-8a71-f4c8ed5ea329 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:44.643745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ca2c8-36e0-446c-a37d-0930be2d0a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:44.644499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca2c8-36e0-446c-a37d-0930be2d0a3a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.644881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca2c8-36e0-446c-a37d-0930be2d0a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.645370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca2c8-36e0-446c-a37d-0930be2d0a3a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.646132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca2c8-36e0-446c-a37d-0930be2d0a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:44.646513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca2c8-36e0-446c-a37d-0930be2d0a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:44.647977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca2c8-36e0-446c-a37d-0930be2d0a3a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:44.664299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 348/682] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:44.666172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ca2c8-36e0-446c-a37d-0930be2d0a3a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:44.684598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:44.704571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:44.714906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb956997-cdf2-495b-963e-228d41bbeddb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:44.760285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1cf95-cb0f-49b5-8439-a18fca846fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:44.761672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1cf95-cb0f-49b5-8439-a18fca846fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.762210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1cf95-cb0f-49b5-8439-a18fca846fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.762690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1cf95-cb0f-49b5-8439-a18fca846fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.763693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1cf95-cb0f-49b5-8439-a18fca846fc8 None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=d4f8f6b881a9476bb0951bc68d17ca70) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:44.764245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1cf95-cb0f-49b5-8439-a18fca846fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:44.765939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1cf95-cb0f-49b5-8439-a18fca846fc8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:44.773396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 335/683] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:44 2022] GET /identity/v3/role_assignments?user.id=d4f8f6b881a9476bb0951bc68d17ca70&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:44.775078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1cf95-cb0f-49b5-8439-a18fca846fc8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:44.818804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ca2c8-36e0-446c-a37d-0930be2d0a3a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:44.884916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfd3e6-88b2-4bf9-810a-ab1073775e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:44.886573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfd3e6-88b2-4bf9-810a-ab1073775e0c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.886859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfd3e6-88b2-4bf9-810a-ab1073775e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.887134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbfd3e6-88b2-4bf9-810a-ab1073775e0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.887885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfd3e6-88b2-4bf9-810a-ab1073775e0c None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=e0b66989d4df4398ad723f587cbc24bd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:44.888199 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfd3e6-88b2-4bf9-810a-ab1073775e0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:44.889675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbfd3e6-88b2-4bf9-810a-ab1073775e0c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:44.900210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 349/684] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:44 2022] GET /identity/v3/role_assignments?user.id=e0b66989d4df4398ad723f587cbc24bd&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:44.901098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfd3e6-88b2-4bf9-810a-ab1073775e0c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:45.004336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1cf95-cb0f-49b5-8439-a18fca846fc8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:45.007807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:45.044899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbfd3e6-88b2-4bf9-810a-ab1073775e0c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:45.052384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2ab9a-df5d-4e90-899b-4859b82cca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:45.053467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2ab9a-df5d-4e90-899b-4859b82cca28 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:45.053988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2ab9a-df5d-4e90-899b-4859b82cca28 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:45.054524 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2ab9a-df5d-4e90-899b-4859b82cca28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:45.065093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2ab9a-df5d-4e90-899b-4859b82cca28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:45.067161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2ab9a-df5d-4e90-899b-4859b82cca28 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4ea2ab9a-df5d-4e90-899b-4859b82cca28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:45.084074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:45.085076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:45.086006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:45.086629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee37ab-6b70-4044-b3e8-b885531b897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:45.086629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee37ab-6b70-4044-b3e8-b885531b897d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:45.087312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee37ab-6b70-4044-b3e8-b885531b897d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:45.087312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee37ab-6b70-4044-b3e8-b885531b897d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:45.089376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 336/685] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:45.094512 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2ab9a-df5d-4e90-899b-4859b82cca28 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:45.107140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee37ab-6b70-4044-b3e8-b885531b897d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-acee37ab-6b70-4044-b3e8-b885531b897d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:45.112842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:45.113834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:45.115168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 350/686] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:45.121221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee37ab-6b70-4044-b3e8-b885531b897d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:45.124602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:45.235637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2ab9a-df5d-4e90-899b-4859b82cca28 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:45.265600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee37ab-6b70-4044-b3e8-b885531b897d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:45.276659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709beb34-a561-4d04-a8cb-9c66c662089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:45.277715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709beb34-a561-4d04-a8cb-9c66c662089b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:45.278220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709beb34-a561-4d04-a8cb-9c66c662089b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:45.278686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709beb34-a561-4d04-a8cb-9c66c662089b None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:45.279624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709beb34-a561-4d04-a8cb-9c66c662089b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:45.280418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709beb34-a561-4d04-a8cb-9c66c662089b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:45.282838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709beb34-a561-4d04-a8cb-9c66c662089b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:45.302236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cd6b4-9c17-469a-b48e-e5a28305d4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:45.302850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cd6b4-9c17-469a-b48e-e5a28305d4dc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:45.303133 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cd6b4-9c17-469a-b48e-e5a28305d4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:45.303409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cd6b4-9c17-469a-b48e-e5a28305d4dc None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:45.304084 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cd6b4-9c17-469a-b48e-e5a28305d4dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:45.304388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cd6b4-9c17-469a-b48e-e5a28305d4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:45.305928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 337/687] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 08:43:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:45.310907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cd6b4-9c17-469a-b48e-e5a28305d4dc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:45.311991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709beb34-a561-4d04-a8cb-9c66c662089b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:45.313996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:45.328477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 351/688] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:45.330683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cd6b4-9c17-469a-b48e-e5a28305d4dc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:45.417026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:45.443584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709beb34-a561-4d04-a8cb-9c66c662089b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:45.463672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cd6b4-9c17-469a-b48e-e5a28305d4dc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:45.507478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a22b9-bb57-4355-9e48-57d9442ca1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:45.508452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a22b9-bb57-4355-9e48-57d9442ca1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:45.508911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a22b9-bb57-4355-9e48-57d9442ca1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:45.509416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a22b9-bb57-4355-9e48-57d9442ca1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:45.521069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a22b9-bb57-4355-9e48-57d9442ca1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:45.522917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a22b9-bb57-4355-9e48-57d9442ca1a9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:45.523711 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0c82d-4472-4494-a83b-099659817908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:45.524881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0c82d-4472-4494-a83b-099659817908 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:45.525140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0c82d-4472-4494-a83b-099659817908 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:45.525405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0c82d-4472-4494-a83b-099659817908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-987a22b9-bb57-4355-9e48-57d9442ca1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:45.541990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:45.543040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:45.543918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:45.543918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:45.543918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:45.549540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 352/689] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:45.551903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a22b9-bb57-4355-9e48-57d9442ca1a9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:45.609687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:45.668928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a22b9-bb57-4355-9e48-57d9442ca1a9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:45.706230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838b3fe-a9ab-404c-93c6-cffc2680710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:45.706857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0c82d-4472-4494-a83b-099659817908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:45.707334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838b3fe-a9ab-404c-93c6-cffc2680710a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:45.707784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838b3fe-a9ab-404c-93c6-cffc2680710a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:45.708197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838b3fe-a9ab-404c-93c6-cffc2680710a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:45.708313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0c82d-4472-4494-a83b-099659817908 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:45.709074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838b3fe-a9ab-404c-93c6-cffc2680710a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:45.709517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838b3fe-a9ab-404c-93c6-cffc2680710a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:45.711922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838b3fe-a9ab-404c-93c6-cffc2680710a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:45.731911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 353/690] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:45.734345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838b3fe-a9ab-404c-93c6-cffc2680710a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:45.851670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838b3fe-a9ab-404c-93c6-cffc2680710a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:45.863984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:45.871434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:45.895310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b5b3d-1111-4742-9581-2ded39ee1042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:45.895949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b5b3d-1111-4742-9581-2ded39ee1042 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:45.896226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b5b3d-1111-4742-9581-2ded39ee1042 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:45.896495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b5b3d-1111-4742-9581-2ded39ee1042 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:45.905437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b5b3d-1111-4742-9581-2ded39ee1042 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:45.907453 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b5b3d-1111-4742-9581-2ded39ee1042 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:45.912941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 338/691] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7e2b5b3d-1111-4742-9581-2ded39ee1042 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:45.924541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:45.925584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:45.926530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:45.930457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 354/692] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 08:43:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:45.938934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b5b3d-1111-4742-9581-2ded39ee1042 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:45.939206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0c82d-4472-4494-a83b-099659817908 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:46.135586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0c82d-4472-4494-a83b-099659817908 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:46.142034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b5b3d-1111-4742-9581-2ded39ee1042 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:46.173112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7627edd-4ab2-49c5-aa64-8935440decb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:46.173888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7627edd-4ab2-49c5-aa64-8935440decb8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:46.174340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7627edd-4ab2-49c5-aa64-8935440decb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:46.174844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7627edd-4ab2-49c5-aa64-8935440decb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:46.183679 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9a98f-783d-4a3f-82df-5ec9f955d964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:46.184485 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9a98f-783d-4a3f-82df-5ec9f955d964 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:46.185432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9a98f-783d-4a3f-82df-5ec9f955d964 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:46.185864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9a98f-783d-4a3f-82df-5ec9f955d964 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:46.187061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9a98f-783d-4a3f-82df-5ec9f955d964 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:46.187180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7627edd-4ab2-49c5-aa64-8935440decb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:46.187643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9a98f-783d-4a3f-82df-5ec9f955d964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:46.188841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7627edd-4ab2-49c5-aa64-8935440decb8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:46.189396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9a98f-783d-4a3f-82df-5ec9f955d964 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d7627edd-4ab2-49c5-aa64-8935440decb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:46.205258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:46.206486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:46.207588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:46.207588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:46.207588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:46.209312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 339/693] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:46.210907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d51a2e-8578-44f3-9e1a-98978c9eb65a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:46.211287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d51a2e-8578-44f3-9e1a-98978c9eb65a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:46.212205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d51a2e-8578-44f3-9e1a-98978c9eb65a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:46.213705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 355/694] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 08:43:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:46.215247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9a98f-783d-4a3f-82df-5ec9f955d964 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:46.217865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 340/695] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:46.219245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0b33-8f53-4ee1-a809-3a8f793dc43e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:46.219626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0b33-8f53-4ee1-a809-3a8f793dc43e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:46.220014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0b33-8f53-4ee1-a809-3a8f793dc43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:46.247518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bfcf0b33-8f53-4ee1-a809-3a8f793dc43e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:46.248155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:46.250275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bfcf0b33-8f53-4ee1-a809-3a8f793dc43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:46.274396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:46.322565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 341/696] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:46.323809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf0b33-8f53-4ee1-a809-3a8f793dc43e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:46.332114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9a98f-783d-4a3f-82df-5ec9f955d964 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:46.398745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff660f6-73a7-4f39-a4ab-3c93056112a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:46.400511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff660f6-73a7-4f39-a4ab-3c93056112a5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:46.400995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff660f6-73a7-4f39-a4ab-3c93056112a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:46.401274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff660f6-73a7-4f39-a4ab-3c93056112a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:46.401915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff660f6-73a7-4f39-a4ab-3c93056112a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:46.402239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff660f6-73a7-4f39-a4ab-3c93056112a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:46.403602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff660f6-73a7-4f39-a4ab-3c93056112a5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:46.427146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 356/697] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:46.433793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff660f6-73a7-4f39-a4ab-3c93056112a5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:46.495486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf0b33-8f53-4ee1-a809-3a8f793dc43e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:46.541258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22211db7-fcc0-4c82-b9b3-e24320ea3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:46.541858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211db7-fcc0-4c82-b9b3-e24320ea3189 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:46.546661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211db7-fcc0-4c82-b9b3-e24320ea3189 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:46.546661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211db7-fcc0-4c82-b9b3-e24320ea3189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:46.583083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:46.595809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:46.609398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff660f6-73a7-4f39-a4ab-3c93056112a5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:46.656576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652cac-77f2-43df-9501-a4ef2f58c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:46.657188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652cac-77f2-43df-9501-a4ef2f58c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:46.657479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652cac-77f2-43df-9501-a4ef2f58c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:46.657826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77652cac-77f2-43df-9501-a4ef2f58c4a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:46.664841 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77652cac-77f2-43df-9501-a4ef2f58c4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:46.669724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77652cac-77f2-43df-9501-a4ef2f58c4a4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:46.674388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22211db7-fcc0-4c82-b9b3-e24320ea3189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:46.676122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22211db7-fcc0-4c82-b9b3-e24320ea3189 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-77652cac-77f2-43df-9501-a4ef2f58c4a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:46.678664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:46.679534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:46.680497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:46.680497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:46.680497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:46.680497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:46.680497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:46.680497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:46.680497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:46.680497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:46.680497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 357/698] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:43:46.680993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652cac-77f2-43df-9501-a4ef2f58c4a4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:46.785463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77652cac-77f2-43df-9501-a4ef2f58c4a4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:46.790642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 342/699] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:46.791774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22211db7-fcc0-4c82-b9b3-e24320ea3189 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:46.821986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04a31d-3d96-4496-8a91-613e42a6e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:46.822716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04a31d-3d96-4496-8a91-613e42a6e6bd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:46.823091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04a31d-3d96-4496-8a91-613e42a6e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:46.823497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04a31d-3d96-4496-8a91-613e42a6e6bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:46.834027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04a31d-3d96-4496-8a91-613e42a6e6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:46.835752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04a31d-3d96-4496-8a91-613e42a6e6bd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:46.842566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-de04a31d-3d96-4496-8a91-613e42a6e6bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:46.851213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:46.859827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:46.860931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:46.860931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:46.860931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:46.860931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 358/700] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:46.860931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04a31d-3d96-4496-8a91-613e42a6e6bd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:46.861692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:46.905727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22211db7-fcc0-4c82-b9b3-e24320ea3189 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:46.943503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d043e0-c6b7-4c47-a86a-2f59d84b42a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:46.944334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d043e0-c6b7-4c47-a86a-2f59d84b42a2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:46.944771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d043e0-c6b7-4c47-a86a-2f59d84b42a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:46.945191 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d043e0-c6b7-4c47-a86a-2f59d84b42a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:46.946105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d043e0-c6b7-4c47-a86a-2f59d84b42a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:46.946582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d043e0-c6b7-4c47-a86a-2f59d84b42a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:46.948237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d043e0-c6b7-4c47-a86a-2f59d84b42a2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:46.966064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 343/701] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:46.967278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d043e0-c6b7-4c47-a86a-2f59d84b42a2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:46.973038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04a31d-3d96-4496-8a91-613e42a6e6bd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:47.008900 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384723c4-3b06-4963-ae01-2cd88a3a5fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:47.009533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384723c4-3b06-4963-ae01-2cd88a3a5fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.009811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384723c4-3b06-4963-ae01-2cd88a3a5fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.010099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384723c4-3b06-4963-ae01-2cd88a3a5fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.021189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384723c4-3b06-4963-ae01-2cd88a3a5fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:47.022684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384723c4-3b06-4963-ae01-2cd88a3a5fe0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-384723c4-3b06-4963-ae01-2cd88a3a5fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:47.037811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:47.038816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:47.040281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:47.040281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:47.040281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:47.040281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 359/702] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:47.040954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384723c4-3b06-4963-ae01-2cd88a3a5fe0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:47.077874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d043e0-c6b7-4c47-a86a-2f59d84b42a2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:47.092327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:47.097234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:47.115490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da1fb5-b7c0-45b3-bc68-a4f7e761c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:47.116454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da1fb5-b7c0-45b3-bc68-a4f7e761c455 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.116977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da1fb5-b7c0-45b3-bc68-a4f7e761c455 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.117511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da1fb5-b7c0-45b3-bc68-a4f7e761c455 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.118904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da1fb5-b7c0-45b3-bc68-a4f7e761c455 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:47.119415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da1fb5-b7c0-45b3-bc68-a4f7e761c455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:47.120987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da1fb5-b7c0-45b3-bc68-a4f7e761c455 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:47.137690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 344/703] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:47.139306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da1fb5-b7c0-45b3-bc68-a4f7e761c455 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:47.145861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384723c4-3b06-4963-ae01-2cd88a3a5fe0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:47.181937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790af1-b131-4d0b-8379-b9a7674fa73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:47.182867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790af1-b131-4d0b-8379-b9a7674fa73d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.182867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790af1-b131-4d0b-8379-b9a7674fa73d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.183113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790af1-b131-4d0b-8379-b9a7674fa73d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.183906 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790af1-b131-4d0b-8379-b9a7674fa73d None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=88353e858ec64a9cbdcfd16dbc00ebe3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:47.184214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790af1-b131-4d0b-8379-b9a7674fa73d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:47.185700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790af1-b131-4d0b-8379-b9a7674fa73d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:47.198193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 360/704] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:47 2022] GET /identity/v3/role_assignments?user.id=88353e858ec64a9cbdcfd16dbc00ebe3&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:47.198193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790af1-b131-4d0b-8379-b9a7674fa73d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:47.260252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da1fb5-b7c0-45b3-bc68-a4f7e761c455 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:47.304520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcedd3d-479a-4b61-bb9f-9881689e90bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:47.306780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedd3d-479a-4b61-bb9f-9881689e90bc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.307219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedd3d-479a-4b61-bb9f-9881689e90bc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.308346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcedd3d-479a-4b61-bb9f-9881689e90bc None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.309262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcedd3d-479a-4b61-bb9f-9881689e90bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:47.310772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcedd3d-479a-4b61-bb9f-9881689e90bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:47.312462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcedd3d-479a-4b61-bb9f-9881689e90bc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:47.342131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 345/705] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:47.351052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcedd3d-479a-4b61-bb9f-9881689e90bc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:47.366138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790af1-b131-4d0b-8379-b9a7674fa73d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:47.378370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:47.402204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb46ddb-e0e0-4426-ba73-d0e6ba55176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:47.404123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb46ddb-e0e0-4426-ba73-d0e6ba55176b None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.407024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb46ddb-e0e0-4426-ba73-d0e6ba55176b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.407573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb46ddb-e0e0-4426-ba73-d0e6ba55176b None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.409137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb46ddb-e0e0-4426-ba73-d0e6ba55176b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:47.412385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb46ddb-e0e0-4426-ba73-d0e6ba55176b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:47.430516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:47.506279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcedd3d-479a-4b61-bb9f-9881689e90bc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:47.515831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 361/706] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:43:47 2022] POST /identity/v3/users => generated 254 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:43:47.517838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bded28-f643-4244-84eb-f6f8177da615 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.518852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bded28-f643-4244-84eb-f6f8177da615 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.519393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bded28-f643-4244-84eb-f6f8177da615 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.526685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 362/707] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:47.528319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35c599-3cd9-4835-b084-808228d4c2fe None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.528602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35c599-3cd9-4835-b084-808228d4c2fe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.530242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35c599-3cd9-4835-b084-808228d4c2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.561403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2661ae-441a-4632-a9af-04847396ed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:47.562058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2661ae-441a-4632-a9af-04847396ed00 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.562387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2661ae-441a-4632-a9af-04847396ed00 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.563477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2661ae-441a-4632-a9af-04847396ed00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.564071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6e35c599-3cd9-4835-b084-808228d4c2fe None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:47.566763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e35c599-3cd9-4835-b084-808228d4c2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:47.572790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2661ae-441a-4632-a9af-04847396ed00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:47.574121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2661ae-441a-4632-a9af-04847396ed00 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4b2661ae-441a-4632-a9af-04847396ed00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:47.588505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:47.589468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:47.590797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:47.590797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:47.590797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:47.590797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:47.590797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:47.590797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:47.590797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:47.590797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:47.590797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 346/708] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:47.598242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1910c-b11e-4f20-a6c7-6ea532ee8209 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.598242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1910c-b11e-4f20-a6c7-6ea532ee8209 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.598242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1910c-b11e-4f20-a6c7-6ea532ee8209 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.598242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 347/709] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:47.598548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1910c-b11e-4f20-a6c7-6ea532ee8209 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:47.668254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 363/710] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:47.669633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2da0c-9eb2-42f7-92b4-1141a2865a13 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.669929 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2da0c-9eb2-42f7-92b4-1141a2865a13 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.670282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2da0c-9eb2-42f7-92b4-1141a2865a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.689874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e3e2da0c-9eb2-42f7-92b4-1141a2865a13 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:47.691152 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e3e2da0c-9eb2-42f7-92b4-1141a2865a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:47.738259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:47.744396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1910c-b11e-4f20-a6c7-6ea532ee8209 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:47.774656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 364/711] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:47.784350 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7883655-b098-4afd-a4d2-bfb88591d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:47.785180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7883655-b098-4afd-a4d2-bfb88591d555 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.785614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7883655-b098-4afd-a4d2-bfb88591d555 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.786063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7883655-b098-4afd-a4d2-bfb88591d555 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.786929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7883655-b098-4afd-a4d2-bfb88591d555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:47.787388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7883655-b098-4afd-a4d2-bfb88591d555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:47.789032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7883655-b098-4afd-a4d2-bfb88591d555 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:47.802291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 348/712] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:47.810139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2da0c-9eb2-42f7-92b4-1141a2865a13 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:47.849901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:47.944989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2da0c-9eb2-42f7-92b4-1141a2865a13 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:47.983389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654af7c4-0b2e-4273-ae62-a4a1de081b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:47.984053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654af7c4-0b2e-4273-ae62-a4a1de081b63 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:47.984335 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654af7c4-0b2e-4273-ae62-a4a1de081b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:47.984668 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654af7c4-0b2e-4273-ae62-a4a1de081b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:47.985403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654af7c4-0b2e-4273-ae62-a4a1de081b63 None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=9f31f738fe094e4ea7ed440e661e2111) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:47.985715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654af7c4-0b2e-4273-ae62-a4a1de081b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:47.987240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654af7c4-0b2e-4273-ae62-a4a1de081b63 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:47.994496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 365/713] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:47 2022] GET /identity/v3/role_assignments?user.id=9f31f738fe094e4ea7ed440e661e2111&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:48.007371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7883655-b098-4afd-a4d2-bfb88591d555 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:48.095655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654af7c4-0b2e-4273-ae62-a4a1de081b63 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:48.146119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7883655-b098-4afd-a4d2-bfb88591d555 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:48.191047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb43674-8a4b-45e4-adc1-974ae89b68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:48.191718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb43674-8a4b-45e4-adc1-974ae89b68bf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:48.191999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb43674-8a4b-45e4-adc1-974ae89b68bf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:48.192271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb43674-8a4b-45e4-adc1-974ae89b68bf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:48.192875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb43674-8a4b-45e4-adc1-974ae89b68bf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:48.194496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb43674-8a4b-45e4-adc1-974ae89b68bf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5fb43674-8a4b-45e4-adc1-974ae89b68bf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:48.212752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:48.213978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:43:48.214888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:48.218169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 349/714] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Oct 4 08:43:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:48.220385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb43674-8a4b-45e4-adc1-974ae89b68bf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:48.248705 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:48.298517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:48.312730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654af7c4-0b2e-4273-ae62-a4a1de081b63 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:48.364774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224bb43-3024-40ca-bea3-a605c684a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:48.365426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224bb43-3024-40ca-bea3-a605c684a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:48.365700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224bb43-3024-40ca-bea3-a605c684a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:48.365968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224bb43-3024-40ca-bea3-a605c684a5d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:48.366602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224bb43-3024-40ca-bea3-a605c684a5d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:48.370313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224bb43-3024-40ca-bea3-a605c684a5d8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7224bb43-3024-40ca-bea3-a605c684a5d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:48.390550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:48.391727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:48.392955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 366/715] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:48 2022] GET /identity/v3/services/network => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:48.398231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224bb43-3024-40ca-bea3-a605c684a5d8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:48.402897 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb43674-8a4b-45e4-adc1-974ae89b68bf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:48.443283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfee7a-35bf-4616-b082-ec816783e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:48.444336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfee7a-35bf-4616-b082-ec816783e91a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:48.444798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfee7a-35bf-4616-b082-ec816783e91a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:48.445250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfee7a-35bf-4616-b082-ec816783e91a None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:48.446117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfee7a-35bf-4616-b082-ec816783e91a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:48.446620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfee7a-35bf-4616-b082-ec816783e91a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:48.448173 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfee7a-35bf-4616-b082-ec816783e91a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:48.453460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 350/716] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 08:43:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:48.461174 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfee7a-35bf-4616-b082-ec816783e91a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:48.577283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224bb43-3024-40ca-bea3-a605c684a5d8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:48.613739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b427e-cbac-4f91-82c0-388916e32777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:48.614376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b427e-cbac-4f91-82c0-388916e32777 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:48.614655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b427e-cbac-4f91-82c0-388916e32777 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:48.614984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b427e-cbac-4f91-82c0-388916e32777 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:48.615558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b427e-cbac-4f91-82c0-388916e32777 None admin] RBAC: Adding query filter params (name=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:48.615861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b427e-cbac-4f91-82c0-388916e32777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:48.617228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b427e-cbac-4f91-82c0-388916e32777 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:48.619151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:48.623785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 367/717] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:43:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:48.629103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b427e-cbac-4f91-82c0-388916e32777 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:48.646062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfee7a-35bf-4616-b082-ec816783e91a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:48.674751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:48.705821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97148bcc-9493-4639-a823-9e7507483cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:48.706469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97148bcc-9493-4639-a823-9e7507483cbb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:48.706752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97148bcc-9493-4639-a823-9e7507483cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:48.707027 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97148bcc-9493-4639-a823-9e7507483cbb None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:48.707664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97148bcc-9493-4639-a823-9e7507483cbb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:48.707971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97148bcc-9493-4639-a823-9e7507483cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:48.709356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97148bcc-9493-4639-a823-9e7507483cbb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:48.720137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 351/718] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 08:43:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:48.792876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b427e-cbac-4f91-82c0-388916e32777 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:48.850925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094db5-5bba-4ca9-b888-a81cd236de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:48.851569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094db5-5bba-4ca9-b888-a81cd236de0b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:48.851914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094db5-5bba-4ca9-b888-a81cd236de0b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:48.852739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094db5-5bba-4ca9-b888-a81cd236de0b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:48.853405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094db5-5bba-4ca9-b888-a81cd236de0b None admin] RBAC: Adding query filter params (type=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:48.853764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094db5-5bba-4ca9-b888-a81cd236de0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:48.855550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094db5-5bba-4ca9-b888-a81cd236de0b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:48.862219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 368/719] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:43:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:49.990170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030787a-4892-4bd8-9706-e6191db33d1d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:49.990730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030787a-4892-4bd8-9706-e6191db33d1d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:49.990730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030787a-4892-4bd8-9706-e6191db33d1d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:49.992343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 352/720] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:49.998329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dba28-5fd7-4644-b65e-99775f1f1f99 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:49.998825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dba28-5fd7-4644-b65e-99775f1f1f99 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:49.998958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dba28-5fd7-4644-b65e-99775f1f1f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:50.024381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c72dba28-5fd7-4644-b65e-99775f1f1f99 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:50.025602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c72dba28-5fd7-4644-b65e-99775f1f1f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:50.110724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 369/721] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:50.312277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb341518-6795-4ee5-9a60-1981e06b248e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:50.312465 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb341518-6795-4ee5-9a60-1981e06b248e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:50.312749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb341518-6795-4ee5-9a60-1981e06b248e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:50.314649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 353/722] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:50.319651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5015ad4-8bdf-4d43-a5b7-2113845b7b15 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:50.320189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5015ad4-8bdf-4d43-a5b7-2113845b7b15 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:50.320914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5015ad4-8bdf-4d43-a5b7-2113845b7b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:50.347015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b5015ad4-8bdf-4d43-a5b7-2113845b7b15 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:50.348529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b5015ad4-8bdf-4d43-a5b7-2113845b7b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:50.360670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:50.439715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 370/723] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:50.539010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb341518-6795-4ee5-9a60-1981e06b248e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:50.630022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f554db-a625-498f-8f53-c422abd5a1be None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:50.630602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f554db-a625-498f-8f53-c422abd5a1be None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:50.631031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f554db-a625-498f-8f53-c422abd5a1be None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:50.632508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 371/724] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:50.638467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93f8fb-7add-4566-b380-9540efc53326 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:50.638755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93f8fb-7add-4566-b380-9540efc53326 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:50.639033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93f8fb-7add-4566-b380-9540efc53326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:50.666344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fd93f8fb-7add-4566-b380-9540efc53326 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:50.667543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd93f8fb-7add-4566-b380-9540efc53326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:50.685580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb341518-6795-4ee5-9a60-1981e06b248e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:50.739611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f61f3-b058-46c7-a618-58b9815355e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:50.740259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f61f3-b058-46c7-a618-58b9815355e9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:50.740543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f61f3-b058-46c7-a618-58b9815355e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:50.740819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f61f3-b058-46c7-a618-58b9815355e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:50.764542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f61f3-b058-46c7-a618-58b9815355e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-806f61f3-b058-46c7-a618-58b9815355e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:50.769954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:50.778953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 354/725] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:50.779803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f61f3-b058-46c7-a618-58b9815355e9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:50.787186 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 372/726] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:43:50.788268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93f8fb-7add-4566-b380-9540efc53326 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:50.799489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:50.937504 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:50.967718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f61f3-b058-46c7-a618-58b9815355e9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:50.984096 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93f8fb-7add-4566-b380-9540efc53326 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.030852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54215e-c7b1-4661-a58d-4901e1881556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.031528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54215e-c7b1-4661-a58d-4901e1881556 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.031817 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54215e-c7b1-4661-a58d-4901e1881556 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.032095 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54215e-c7b1-4661-a58d-4901e1881556 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.032767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54215e-c7b1-4661-a58d-4901e1881556 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:51.033072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54215e-c7b1-4661-a58d-4901e1881556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:51.037204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54215e-c7b1-4661-a58d-4901e1881556 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:51.047323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521f9fd-0fca-407c-a342-a9d2743222d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.047964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521f9fd-0fca-407c-a342-a9d2743222d0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.048251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521f9fd-0fca-407c-a342-a9d2743222d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.048532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521f9fd-0fca-407c-a342-a9d2743222d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.053136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 355/727] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:51.059569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54215e-c7b1-4661-a58d-4901e1881556 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.070275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521f9fd-0fca-407c-a342-a9d2743222d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d521f9fd-0fca-407c-a342-a9d2743222d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:51.075615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:51.076764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:51.077833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:51.080013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 373/728] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:51.085233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521f9fd-0fca-407c-a342-a9d2743222d0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.168897 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:51.208609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54215e-c7b1-4661-a58d-4901e1881556 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.236758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521f9fd-0fca-407c-a342-a9d2743222d0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.251807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93ca5-b122-4620-9397-11f0937abbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.253266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93ca5-b122-4620-9397-11f0937abbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.253997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93ca5-b122-4620-9397-11f0937abbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.254457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b93ca5-b122-4620-9397-11f0937abbb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.269270 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93ca5-b122-4620-9397-11f0937abbb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:51.271227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b93ca5-b122-4620-9397-11f0937abbb4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:51.283251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff69eb6-c531-4730-b403-7ba94124e8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.284294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff69eb6-c531-4730-b403-7ba94124e8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.284671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff69eb6-c531-4730-b403-7ba94124e8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.285040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff69eb6-c531-4730-b403-7ba94124e8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.285816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff69eb6-c531-4730-b403-7ba94124e8c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:51.286269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff69eb6-c531-4730-b403-7ba94124e8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:51.287731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff69eb6-c531-4730-b403-7ba94124e8c1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:51.291236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-42b93ca5-b122-4620-9397-11f0937abbb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:51.292785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:51.293930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:51.295072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:51.295072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:51.295072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:51.301770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 356/729] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:51.301770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93ca5-b122-4620-9397-11f0937abbb4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.306302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 374/730] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:51.308108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff69eb6-c531-4730-b403-7ba94124e8c1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.410694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b93ca5-b122-4620-9397-11f0937abbb4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.419541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff69eb6-c531-4730-b403-7ba94124e8c1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.435832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:51.447855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c30592-a707-4525-881d-54d37bf452ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.448595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30592-a707-4525-881d-54d37bf452ec None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.448906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30592-a707-4525-881d-54d37bf452ec None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.449398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30592-a707-4525-881d-54d37bf452ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.456836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638ed41-4700-446e-87fc-6225cd04a590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.457448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638ed41-4700-446e-87fc-6225cd04a590 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.457726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638ed41-4700-446e-87fc-6225cd04a590 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.458002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638ed41-4700-446e-87fc-6225cd04a590 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.458738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638ed41-4700-446e-87fc-6225cd04a590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:51.458987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638ed41-4700-446e-87fc-6225cd04a590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:51.460412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638ed41-4700-446e-87fc-6225cd04a590 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:51.462177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c30592-a707-4525-881d-54d37bf452ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-49c30592-a707-4525-881d-54d37bf452ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:51.467381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:51.468477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:51.469488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:51.474119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 357/731] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:51.474119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c30592-a707-4525-881d-54d37bf452ec None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.474682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 375/732] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:51.475794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c23729-f9bf-47c0-a387-b30708748e2c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.476081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c23729-f9bf-47c0-a387-b30708748e2c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.476353 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c23729-f9bf-47c0-a387-b30708748e2c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.477709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 376/733] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:51.480304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c23729-f9bf-47c0-a387-b30708748e2c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.543226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:51.587116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c23729-f9bf-47c0-a387-b30708748e2c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.587638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c30592-a707-4525-881d-54d37bf452ec None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.620976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5336ab-28eb-4a39-8e77-8770aab249ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.621622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5336ab-28eb-4a39-8e77-8770aab249ab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.621908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5336ab-28eb-4a39-8e77-8770aab249ab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.622213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5336ab-28eb-4a39-8e77-8770aab249ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.625603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cb0ad-072c-4c3c-856c-a80fa03fe6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.627126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cb0ad-072c-4c3c-856c-a80fa03fe6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.627892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cb0ad-072c-4c3c-856c-a80fa03fe6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.628701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cb0ad-072c-4c3c-856c-a80fa03fe6f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.630729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5336ab-28eb-4a39-8e77-8770aab249ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:51.632233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5336ab-28eb-4a39-8e77-8770aab249ab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:51.643123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cb0ad-072c-4c3c-856c-a80fa03fe6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:51.644914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cb0ad-072c-4c3c-856c-a80fa03fe6f7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6f5336ab-28eb-4a39-8e77-8770aab249ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:51.645185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:51.646277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:51.647217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:51.651363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 377/734] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:51.652152 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5336ab-28eb-4a39-8e77-8770aab249ab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-352cb0ad-072c-4c3c-856c-a80fa03fe6f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:51.664378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:51.665467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:51.666404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:51.666404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:51.666404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:51.666580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 358/735] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:51.667764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9d8f-3939-430f-99ce-e93127bbe5be None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.668047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9d8f-3939-430f-99ce-e93127bbe5be None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.668318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b9d8f-3939-430f-99ce-e93127bbe5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.689071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b79b9d8f-3939-430f-99ce-e93127bbe5be None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:51.690591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b79b9d8f-3939-430f-99ce-e93127bbe5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:51.721218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:51.759766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5336ab-28eb-4a39-8e77-8770aab249ab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.761712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 359/736] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:51.762693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9d8f-3939-430f-99ce-e93127bbe5be None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.785062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:51.802547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097d429-6b07-4e10-a660-492c1c1f45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.803175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097d429-6b07-4e10-a660-492c1c1f45a3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.803459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097d429-6b07-4e10-a660-492c1c1f45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.803743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097d429-6b07-4e10-a660-492c1c1f45a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.804415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097d429-6b07-4e10-a660-492c1c1f45a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:51.805538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097d429-6b07-4e10-a660-492c1c1f45a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:51.806663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097d429-6b07-4e10-a660-492c1c1f45a3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:51.815927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 378/737] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:51.819654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097d429-6b07-4e10-a660-492c1c1f45a3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.871549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b9d8f-3939-430f-99ce-e93127bbe5be None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.908188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd224cce-86d2-4cb8-903e-e33dffdcfa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.908800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224cce-86d2-4cb8-903e-e33dffdcfa73 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.909085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224cce-86d2-4cb8-903e-e33dffdcfa73 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.909363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd224cce-86d2-4cb8-903e-e33dffdcfa73 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.910104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224cce-86d2-4cb8-903e-e33dffdcfa73 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:51.910430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224cce-86d2-4cb8-903e-e33dffdcfa73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:51.911862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd224cce-86d2-4cb8-903e-e33dffdcfa73 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:51.921629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097d429-6b07-4e10-a660-492c1c1f45a3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:51.931930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 360/738] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:51.933179 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760b890-b2a5-4f84-b4b3-df302d0f70e4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.936212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760b890-b2a5-4f84-b4b3-df302d0f70e4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.936212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760b890-b2a5-4f84-b4b3-df302d0f70e4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.939158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 361/739] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:51.940102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760b890-b2a5-4f84-b4b3-df302d0f70e4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:51.965673 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:51.965829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e7a34-7b99-43d9-9b97-644c29aa1ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:51.966858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e7a34-7b99-43d9-9b97-644c29aa1ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:51.967040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e7a34-7b99-43d9-9b97-644c29aa1ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:51.967373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e7a34-7b99-43d9-9b97-644c29aa1ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:51.968101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e7a34-7b99-43d9-9b97-644c29aa1ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:51.968680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e7a34-7b99-43d9-9b97-644c29aa1ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:51.969783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e7a34-7b99-43d9-9b97-644c29aa1ac8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:51.981811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 379/740] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:51.982937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e7a34-7b99-43d9-9b97-644c29aa1ac8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:52.029162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:52.046606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760b890-b2a5-4f84-b4b3-df302d0f70e4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:52.079377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10a413-ed43-4dd8-9fa2-37d83373b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:52.080001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10a413-ed43-4dd8-9fa2-37d83373b936 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.080290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10a413-ed43-4dd8-9fa2-37d83373b936 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.080565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10a413-ed43-4dd8-9fa2-37d83373b936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.087267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e7a34-7b99-43d9-9b97-644c29aa1ac8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:52.091126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10a413-ed43-4dd8-9fa2-37d83373b936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:52.092596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10a413-ed43-4dd8-9fa2-37d83373b936 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0e10a413-ed43-4dd8-9fa2-37d83373b936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:52.107491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:52.108453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:52.109908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:52.109908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:52.109908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:52.109908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 362/741] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:52.110212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501a7c4-741b-465a-a4fc-d0f12158b3e3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.110306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501a7c4-741b-465a-a4fc-d0f12158b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.110589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501a7c4-741b-465a-a4fc-d0f12158b3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.122277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d0aa4-1f2e-4741-b846-75723f3946de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:52.122889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d0aa4-1f2e-4741-b846-75723f3946de None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.123171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d0aa4-1f2e-4741-b846-75723f3946de None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.123450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d0aa4-1f2e-4741-b846-75723f3946de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.128108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6501a7c4-741b-465a-a4fc-d0f12158b3e3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:52.129293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6501a7c4-741b-465a-a4fc-d0f12158b3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:52.189033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d0aa4-1f2e-4741-b846-75723f3946de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:52.190518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d0aa4-1f2e-4741-b846-75723f3946de None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:52.193369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 363/742] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:43:52.194210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501a7c4-741b-465a-a4fc-d0f12158b3e3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:52.208351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:52.230839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:52.300036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 380/743] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:43:52.300036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d0aa4-1f2e-4741-b846-75723f3946de None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:52.304875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501a7c4-741b-465a-a4fc-d0f12158b3e3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:52.340349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752c71-549e-4f2c-ae48-cd387c00dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:52.340984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752c71-549e-4f2c-ae48-cd387c00dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.341267 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752c71-549e-4f2c-ae48-cd387c00dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.341540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752c71-549e-4f2c-ae48-cd387c00dcf7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.348538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba752c71-549e-4f2c-ae48-cd387c00dcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:52.349994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba752c71-549e-4f2c-ae48-cd387c00dcf7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ba752c71-549e-4f2c-ae48-cd387c00dcf7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:52.363165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:52.364096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 364/744] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:43:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:52.365036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752c71-549e-4f2c-ae48-cd387c00dcf7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:52.408277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d0aa4-1f2e-4741-b846-75723f3946de None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:52.431789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:52.443706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af5b7d-0177-4880-a57e-e809d687008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:52.444313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af5b7d-0177-4880-a57e-e809d687008c None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.446224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af5b7d-0177-4880-a57e-e809d687008c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.446224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af5b7d-0177-4880-a57e-e809d687008c None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.446224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af5b7d-0177-4880-a57e-e809d687008c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:52.447516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af5b7d-0177-4880-a57e-e809d687008c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:52.466882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752c71-549e-4f2c-ae48-cd387c00dcf7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:52.500502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03662b97-c2e5-4bc1-ae56-1e8bbe283c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:52.501100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03662b97-c2e5-4bc1-ae56-1e8bbe283c30 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.501392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03662b97-c2e5-4bc1-ae56-1e8bbe283c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.501689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03662b97-c2e5-4bc1-ae56-1e8bbe283c30 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.502356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03662b97-c2e5-4bc1-ae56-1e8bbe283c30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:52.502658 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03662b97-c2e5-4bc1-ae56-1e8bbe283c30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:52.504008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03662b97-c2e5-4bc1-ae56-1e8bbe283c30 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:52.515630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 365/745] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:52.520047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03662b97-c2e5-4bc1-ae56-1e8bbe283c30 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:52.536690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:52.541588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 381/746] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:43:52 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:43:52.542750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af5b7d-0177-4880-a57e-e809d687008c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:52.635499 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03662b97-c2e5-4bc1-ae56-1e8bbe283c30 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:52.665820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:52.666773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af5b7d-0177-4880-a57e-e809d687008c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:52.675273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb42bd-94f3-4422-b90e-bf6c9110eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:52.677104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb42bd-94f3-4422-b90e-bf6c9110eba9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.677104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb42bd-94f3-4422-b90e-bf6c9110eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.677104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb42bd-94f3-4422-b90e-bf6c9110eba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.688405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb42bd-94f3-4422-b90e-bf6c9110eba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:52.689961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb42bd-94f3-4422-b90e-bf6c9110eba9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-24eb42bd-94f3-4422-b90e-bf6c9110eba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:52.705453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:52.706523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:52.712470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:52.712470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:52.712470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:52.712644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ec6ab-f1d5-4fe3-9b39-61572487fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:52.712644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ec6ab-f1d5-4fe3-9b39-61572487fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.712644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ec6ab-f1d5-4fe3-9b39-61572487fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.712863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 366/747] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:52.712938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ec6ab-f1d5-4fe3-9b39-61572487fcf8 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.713006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb42bd-94f3-4422-b90e-bf6c9110eba9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:52.713074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ec6ab-f1d5-4fe3-9b39-61572487fcf8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:52.713074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ec6ab-f1d5-4fe3-9b39-61572487fcf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:52.713074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ec6ab-f1d5-4fe3-9b39-61572487fcf8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:52.731083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 382/748] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 08:43:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:52.731852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ec6ab-f1d5-4fe3-9b39-61572487fcf8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:52.792631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:52.826600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb42bd-94f3-4422-b90e-bf6c9110eba9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:52.837636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ec6ab-f1d5-4fe3-9b39-61572487fcf8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:52.863468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100a11f-9a57-48c8-a9ce-4cbd2f630715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:52.864071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100a11f-9a57-48c8-a9ce-4cbd2f630715 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.864349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100a11f-9a57-48c8-a9ce-4cbd2f630715 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.864621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100a11f-9a57-48c8-a9ce-4cbd2f630715 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.865267 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100a11f-9a57-48c8-a9ce-4cbd2f630715 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:52.866653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100a11f-9a57-48c8-a9ce-4cbd2f630715 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:52.873335 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95791d-4aed-4ae2-8198-7740c84c17c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:52.873808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95791d-4aed-4ae2-8198-7740c84c17c4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:52.874117 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95791d-4aed-4ae2-8198-7740c84c17c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:52.874383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95791d-4aed-4ae2-8198-7740c84c17c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:52.882644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95791d-4aed-4ae2-8198-7740c84c17c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:52.884135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95791d-4aed-4ae2-8198-7740c84c17c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4d95791d-4aed-4ae2-8198-7740c84c17c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:52.895362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:52.896447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 383/749] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 08:43:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:52.897380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95791d-4aed-4ae2-8198-7740c84c17c4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:52.946137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 367/750] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:43:52 2022] POST /identity/v3/services => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:43:52.946137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100a11f-9a57-48c8-a9ce-4cbd2f630715 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.003399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.011989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95791d-4aed-4ae2-8198-7740c84c17c4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.028210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.057811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d99822-8f79-4a96-893c-7952cd0eced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.058795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d99822-8f79-4a96-893c-7952cd0eced0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.059279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d99822-8f79-4a96-893c-7952cd0eced0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.059764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d99822-8f79-4a96-893c-7952cd0eced0 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.060615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d99822-8f79-4a96-893c-7952cd0eced0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:53.061109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d99822-8f79-4a96-893c-7952cd0eced0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.062739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d99822-8f79-4a96-893c-7952cd0eced0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.076903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 384/751] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:53.078156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d99822-8f79-4a96-893c-7952cd0eced0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.078478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100a11f-9a57-48c8-a9ce-4cbd2f630715 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.121295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa7b0-b194-4f45-9702-ae7c565ec302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.121916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa7b0-b194-4f45-9702-ae7c565ec302 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.122220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa7b0-b194-4f45-9702-ae7c565ec302 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.122494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa7b0-b194-4f45-9702-ae7c565ec302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.206635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d99822-8f79-4a96-893c-7952cd0eced0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.213035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa7b0-b194-4f45-9702-ae7c565ec302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.214633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa7b0-b194-4f45-9702-ae7c565ec302 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.253570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069b6f5-bbb1-40f4-be45-76f0559e6eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.254575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069b6f5-bbb1-40f4-be45-76f0559e6eed None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.255267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069b6f5-bbb1-40f4-be45-76f0559e6eed None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.256622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069b6f5-bbb1-40f4-be45-76f0559e6eed None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.257554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069b6f5-bbb1-40f4-be45-76f0559e6eed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:53.258129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069b6f5-bbb1-40f4-be45-76f0559e6eed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.259827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069b6f5-bbb1-40f4-be45-76f0559e6eed None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.261495 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.286118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 385/752] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:53.286118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069b6f5-bbb1-40f4-be45-76f0559e6eed None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.313761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.342494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 368/753] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:43:53.343999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa7b0-b194-4f45-9702-ae7c565ec302 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.394267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069b6f5-bbb1-40f4-be45-76f0559e6eed None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.429507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32454053-a5ef-44ac-95a5-4461f1166d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.431174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32454053-a5ef-44ac-95a5-4461f1166d31 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.431174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32454053-a5ef-44ac-95a5-4461f1166d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.431377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32454053-a5ef-44ac-95a5-4461f1166d31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.438367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32454053-a5ef-44ac-95a5-4461f1166d31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.439976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32454053-a5ef-44ac-95a5-4461f1166d31 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-32454053-a5ef-44ac-95a5-4461f1166d31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:53.451618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:53.452539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:53.453421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:53.453421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:53.453421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:53.453421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:53.453421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:53.453421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:53.453421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:53.453421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:53.453421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 386/754] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:53.454776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32454053-a5ef-44ac-95a5-4461f1166d31 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.468590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa7b0-b194-4f45-9702-ae7c565ec302 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.514042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1ae06-05fa-4ba2-9350-b0a045da3391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.514706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1ae06-05fa-4ba2-9350-b0a045da3391 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.514986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1ae06-05fa-4ba2-9350-b0a045da3391 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.515258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1ae06-05fa-4ba2-9350-b0a045da3391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.522403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.527619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1ae06-05fa-4ba2-9350-b0a045da3391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.529231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1ae06-05fa-4ba2-9350-b0a045da3391 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8cb1ae06-05fa-4ba2-9350-b0a045da3391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:53.545180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:53.546272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:53.547266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:53.547266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:53.547266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:53.547266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 369/755] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:53.547266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1ae06-05fa-4ba2-9350-b0a045da3391 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.569264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.582901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32454053-a5ef-44ac-95a5-4461f1166d31 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.621147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74876-7bd0-43ff-b78b-f6e83ff7cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.621895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74876-7bd0-43ff-b78b-f6e83ff7cd20 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.622300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74876-7bd0-43ff-b78b-f6e83ff7cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.622578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74876-7bd0-43ff-b78b-f6e83ff7cd20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.633639 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c74876-7bd0-43ff-b78b-f6e83ff7cd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.635312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c74876-7bd0-43ff-b78b-f6e83ff7cd20 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b5c74876-7bd0-43ff-b78b-f6e83ff7cd20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:53.651584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:53.652539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:53.653802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:53.653802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:53.653802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:53.653802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 387/756] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:53.654487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74876-7bd0-43ff-b78b-f6e83ff7cd20 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.660833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1ae06-05fa-4ba2-9350-b0a045da3391 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.697338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095eb7-2880-4353-aade-d70b38b0d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.698299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095eb7-2880-4353-aade-d70b38b0d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.698795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095eb7-2880-4353-aade-d70b38b0d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.699316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095eb7-2880-4353-aade-d70b38b0d3f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.700191 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11095eb7-2880-4353-aade-d70b38b0d3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:53.700722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11095eb7-2880-4353-aade-d70b38b0d3f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.702355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11095eb7-2880-4353-aade-d70b38b0d3f1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.721869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 370/757] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:53.723057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095eb7-2880-4353-aade-d70b38b0d3f1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.763154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74876-7bd0-43ff-b78b-f6e83ff7cd20 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.778822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.800893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894b79e-2359-4239-902d-ea09da990879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.800893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894b79e-2359-4239-902d-ea09da990879 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.801248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894b79e-2359-4239-902d-ea09da990879 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.801545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894b79e-2359-4239-902d-ea09da990879 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.802234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894b79e-2359-4239-902d-ea09da990879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:53.802578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894b79e-2359-4239-902d-ea09da990879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.804151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894b79e-2359-4239-902d-ea09da990879 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.814197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:53.817613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 388/758] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:53.818666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894b79e-2359-4239-902d-ea09da990879 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.837153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095eb7-2880-4353-aade-d70b38b0d3f1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.876628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31230c-3dbc-4c8a-a4da-84a6c14b43cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.877621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31230c-3dbc-4c8a-a4da-84a6c14b43cd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.878168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31230c-3dbc-4c8a-a4da-84a6c14b43cd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.878645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31230c-3dbc-4c8a-a4da-84a6c14b43cd None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.879593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31230c-3dbc-4c8a-a4da-84a6c14b43cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:53.880200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31230c-3dbc-4c8a-a4da-84a6c14b43cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.881901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31230c-3dbc-4c8a-a4da-84a6c14b43cd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.895929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 371/759] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:53.897162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31230c-3dbc-4c8a-a4da-84a6c14b43cd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:53.930098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894b79e-2359-4239-902d-ea09da990879 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:53.967354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62872f3-0044-4182-9d7b-75f6619c6b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:53.968096 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62872f3-0044-4182-9d7b-75f6619c6b33 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.968350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62872f3-0044-4182-9d7b-75f6619c6b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.968631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62872f3-0044-4182-9d7b-75f6619c6b33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.969362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62872f3-0044-4182-9d7b-75f6619c6b33 None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=88353e858ec64a9cbdcfd16dbc00ebe3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:53.969747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62872f3-0044-4182-9d7b-75f6619c6b33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:53.971279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62872f3-0044-4182-9d7b-75f6619c6b33 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:53.983475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 389/760] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/role_assignments?user.id=88353e858ec64a9cbdcfd16dbc00ebe3&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:53.983475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62872f3-0044-4182-9d7b-75f6619c6b33 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:54.037632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31230c-3dbc-4c8a-a4da-84a6c14b43cd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:54.054552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:54.060619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:54.087342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62872f3-0044-4182-9d7b-75f6619c6b33 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:54.092450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c67d3f-333f-4d3d-9cfd-b385e663c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:54.093842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c67d3f-333f-4d3d-9cfd-b385e663c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.094356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c67d3f-333f-4d3d-9cfd-b385e663c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.094856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c67d3f-333f-4d3d-9cfd-b385e663c7a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.104411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c67d3f-333f-4d3d-9cfd-b385e663c7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:54.106485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c67d3f-333f-4d3d-9cfd-b385e663c7a9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d2c67d3f-333f-4d3d-9cfd-b385e663c7a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:54.119975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:54.120949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:54.122214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:54.122214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:54.122214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:54.122214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:54.122214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:54.122214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:54.122214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:54.122214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:54.124500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badbaa0-b53e-4e7d-a6d4-48ae13ef4ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:54.124644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 372/761] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:54.125145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badbaa0-b53e-4e7d-a6d4-48ae13ef4ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.125466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badbaa0-b53e-4e7d-a6d4-48ae13ef4ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.125711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badbaa0-b53e-4e7d-a6d4-48ae13ef4ff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.134180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c67d3f-333f-4d3d-9cfd-b385e663c7a9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:54.135422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badbaa0-b53e-4e7d-a6d4-48ae13ef4ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:54.136915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badbaa0-b53e-4e7d-a6d4-48ae13ef4ff8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1badbaa0-b53e-4e7d-a6d4-48ae13ef4ff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:54.150205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:54.151165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:54.153653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:54.153653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:54.153653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:54.153653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:54.153653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:54.153653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:54.153653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:54.153653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:54.153653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 390/762] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:54.159336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badbaa0-b53e-4e7d-a6d4-48ae13ef4ff8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:54.313610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badbaa0-b53e-4e7d-a6d4-48ae13ef4ff8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:54.339976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:54.350409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d3855-de0b-4f70-9d49-2fc395ad2842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:54.351179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d3855-de0b-4f70-9d49-2fc395ad2842 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.351520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d3855-de0b-4f70-9d49-2fc395ad2842 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.351852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d3855-de0b-4f70-9d49-2fc395ad2842 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.352560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d3855-de0b-4f70-9d49-2fc395ad2842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:54.352875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d3855-de0b-4f70-9d49-2fc395ad2842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:54.354637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d3855-de0b-4f70-9d49-2fc395ad2842 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:54.368324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 391/763] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:54.374814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d3855-de0b-4f70-9d49-2fc395ad2842 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:54.393274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c67d3f-333f-4d3d-9cfd-b385e663c7a9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:54.463423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4cc85-1e31-427d-8ca8-31d443fd444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:54.464054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4cc85-1e31-427d-8ca8-31d443fd444f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.464335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4cc85-1e31-427d-8ca8-31d443fd444f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.464609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4cc85-1e31-427d-8ca8-31d443fd444f None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.465312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4cc85-1e31-427d-8ca8-31d443fd444f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:54.465620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4cc85-1e31-427d-8ca8-31d443fd444f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:54.467085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4cc85-1e31-427d-8ca8-31d443fd444f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:54.494065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 373/764] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:54.499417 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4cc85-1e31-427d-8ca8-31d443fd444f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:54.526657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d3855-de0b-4f70-9d49-2fc395ad2842 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:54.540195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:54.571907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ed4de-4f6c-4665-a4ce-51be8195faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:54.572448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ed4de-4f6c-4665-a4ce-51be8195faf3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.572738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ed4de-4f6c-4665-a4ce-51be8195faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.573016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ed4de-4f6c-4665-a4ce-51be8195faf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.574312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ed4de-4f6c-4665-a4ce-51be8195faf3 None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=afdc2662bd3148e3b120427adcc1a12b) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:54.574635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ed4de-4f6c-4665-a4ce-51be8195faf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:54.576082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ed4de-4f6c-4665-a4ce-51be8195faf3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:54.591228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 392/765] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:43:54 2022] GET /identity/v3/role_assignments?user.id=afdc2662bd3148e3b120427adcc1a12b&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:54.633857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4cc85-1e31-427d-8ca8-31d443fd444f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:54.684199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3feb1bc-7829-41f8-970e-21353b254b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:54.684874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb1bc-7829-41f8-970e-21353b254b6c None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.685152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb1bc-7829-41f8-970e-21353b254b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.685433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb1bc-7829-41f8-970e-21353b254b6c None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/9f31f738fe094e4ea7ed440e661e2111/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.687383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3feb1bc-7829-41f8-970e-21353b254b6c None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=9f31f738fe094e4ea7ed440e661e2111, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:54.688818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3feb1bc-7829-41f8-970e-21353b254b6c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:54.783837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 374/766] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:43:54 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/9f31f738fe094e4ea7ed440e661e2111/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:54.913854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f47d0f-5d9f-4f04-8a4f-20625a0e8388 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.914833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f47d0f-5d9f-4f04-8a4f-20625a0e8388 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.915119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f47d0f-5d9f-4f04-8a4f-20625a0e8388 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.916708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 393/767] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:54.925565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e64321-4dd7-443e-abb9-d0228da661b9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.925565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e64321-4dd7-443e-abb9-d0228da661b9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.925565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e64321-4dd7-443e-abb9-d0228da661b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.946458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-30e64321-4dd7-443e-abb9-d0228da661b9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:54.948065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30e64321-4dd7-443e-abb9-d0228da661b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:55.027610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 375/768] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:43:55.301446 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f47d0f-5d9f-4f04-8a4f-20625a0e8388 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:55.366217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:55.395479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8b8bb-4901-4b78-8ed6-294196b78f06 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:55.396416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8b8bb-4901-4b78-8ed6-294196b78f06 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:55.396913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8b8bb-4901-4b78-8ed6-294196b78f06 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:55.399253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 376/769] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:55.404839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10e23-f02b-473c-beb7-9d48d61858e4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:55.405398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10e23-f02b-473c-beb7-9d48d61858e4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:55.405866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10e23-f02b-473c-beb7-9d48d61858e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:55.440922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8ad10e23-f02b-473c-beb7-9d48d61858e4 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:55.443450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8ad10e23-f02b-473c-beb7-9d48d61858e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:55.451924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f47d0f-5d9f-4f04-8a4f-20625a0e8388 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:55.476531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:55.521177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0f62c-a5ff-4ab2-928b-6e758fbf4f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:55.521831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0f62c-a5ff-4ab2-928b-6e758fbf4f3d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:55.522127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0f62c-a5ff-4ab2-928b-6e758fbf4f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:55.522467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0f62c-a5ff-4ab2-928b-6e758fbf4f3d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:55.523075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0f62c-a5ff-4ab2-928b-6e758fbf4f3d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:55.524545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0f62c-a5ff-4ab2-928b-6e758fbf4f3d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a2e0f62c-a5ff-4ab2-928b-6e758fbf4f3d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:55.545160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:55.546218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:43:55.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:55.548931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 394/770] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Oct 4 08:43:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:55.563567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0f62c-a5ff-4ab2-928b-6e758fbf4f3d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:55.585508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 377/771] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:43:55.703356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0f62c-a5ff-4ab2-928b-6e758fbf4f3d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:55.721223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:55.754325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fe873-d05b-4214-a243-1a738343ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:55.754948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fe873-d05b-4214-a243-1a738343ee01 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:55.755229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fe873-d05b-4214-a243-1a738343ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:55.755506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fe873-d05b-4214-a243-1a738343ee01 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:55.756148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fe873-d05b-4214-a243-1a738343ee01 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:55.756455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fe873-d05b-4214-a243-1a738343ee01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:55.757884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fe873-d05b-4214-a243-1a738343ee01 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:55.764482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 395/772] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 08:43:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:55.770198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad10e23-f02b-473c-beb7-9d48d61858e4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:55.880629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad10e23-f02b-473c-beb7-9d48d61858e4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:55.890297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fe873-d05b-4214-a243-1a738343ee01 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:55.958596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2666bd-348b-4d37-8b67-47708c9e3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:55.959267 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2666bd-348b-4d37-8b67-47708c9e3a2f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:55.959550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2666bd-348b-4d37-8b67-47708c9e3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:55.959821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2666bd-348b-4d37-8b67-47708c9e3a2f None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:55.960462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2666bd-348b-4d37-8b67-47708c9e3a2f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:55.960805 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2666bd-348b-4d37-8b67-47708c9e3a2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:55.964174 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2666bd-348b-4d37-8b67-47708c9e3a2f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:55.979231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 378/773] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 08:43:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:55.989392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2666bd-348b-4d37-8b67-47708c9e3a2f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:56.012347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:56.095149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2666bd-348b-4d37-8b67-47708c9e3a2f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:56.132117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2501-fd0b-4e5a-886c-476d84d95c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:56.132720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2501-fd0b-4e5a-886c-476d84d95c00 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:56.133415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fe873-d05b-4214-a243-1a738343ee01 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:56.133602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2501-fd0b-4e5a-886c-476d84d95c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:56.133816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2501-fd0b-4e5a-886c-476d84d95c00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:56.134561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2501-fd0b-4e5a-886c-476d84d95c00 None admin] RBAC: Adding query filter params (interface=public, service_id=6ac683bc83604c04a4ed074bd386134d, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:56.134869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2501-fd0b-4e5a-886c-476d84d95c00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:56.136243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2501-fd0b-4e5a-886c-476d84d95c00 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:56.149019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 379/774] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 08:43:55 2022] GET /identity/v3/endpoints?service_id=6ac683bc83604c04a4ed074bd386134d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:56.151672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2501-fd0b-4e5a-886c-476d84d95c00 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:56.223891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db3609-fe90-4d99-9967-a804d845c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:56.224545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db3609-fe90-4d99-9967-a804d845c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:56.224826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db3609-fe90-4d99-9967-a804d845c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:56.225097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db3609-fe90-4d99-9967-a804d845c6c0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:56.225691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db3609-fe90-4d99-9967-a804d845c6c0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:56.227655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db3609-fe90-4d99-9967-a804d845c6c0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:56.237099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-67db3609-fe90-4d99-9967-a804d845c6c0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:56.251051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:56.253029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:56.253871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 396/775] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:55 2022] GET /identity/v3/services/network => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:56.259836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2501-fd0b-4e5a-886c-476d84d95c00 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:56.261267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db3609-fe90-4d99-9967-a804d845c6c0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:56.300196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465a05d-eee1-4957-90da-7447a9be1e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:56.300835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465a05d-eee1-4957-90da-7447a9be1e37 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:56.301124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465a05d-eee1-4957-90da-7447a9be1e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:56.301404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465a05d-eee1-4957-90da-7447a9be1e37 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:56.302036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465a05d-eee1-4957-90da-7447a9be1e37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:56.304047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465a05d-eee1-4957-90da-7447a9be1e37 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:56.315318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 380/776] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 08:43:56 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:56.365277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:56.439911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8bf1-24b2-4e44-a348-8fbaa26a68db None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:56.440549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8bf1-24b2-4e44-a348-8fbaa26a68db None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:56.440717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8bf1-24b2-4e44-a348-8fbaa26a68db None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:56.447204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 381/777] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:43:56.457337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db3609-fe90-4d99-9967-a804d845c6c0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:56.463168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b05a-d7eb-4265-89d6-b85778688b3b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:56.463769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b05a-d7eb-4265-89d6-b85778688b3b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:56.464251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b05a-d7eb-4265-89d6-b85778688b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:56.498653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e113b05a-d7eb-4265-89d6-b85778688b3b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:56.500241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e113b05a-d7eb-4265-89d6-b85778688b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:56.533316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced46bd-7fe5-4ec2-86f7-cf10e54e8828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:56.534005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced46bd-7fe5-4ec2-86f7-cf10e54e8828 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:56.534466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced46bd-7fe5-4ec2-86f7-cf10e54e8828 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:56.534744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced46bd-7fe5-4ec2-86f7-cf10e54e8828 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:56.535384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced46bd-7fe5-4ec2-86f7-cf10e54e8828 None admin] RBAC: Adding query filter params (name=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:56.535687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced46bd-7fe5-4ec2-86f7-cf10e54e8828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:56.537064 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced46bd-7fe5-4ec2-86f7-cf10e54e8828 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:56.544250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 397/778] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:43:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:56.549518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced46bd-7fe5-4ec2-86f7-cf10e54e8828 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:56.603118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 382/779] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:43:56.670170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced46bd-7fe5-4ec2-86f7-cf10e54e8828 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:56.672543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:56.705337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cb852-d4a0-4160-a63d-3d5f68ac314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:56.705863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb852-d4a0-4160-a63d-3d5f68ac314a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:56.706220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb852-d4a0-4160-a63d-3d5f68ac314a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:56.706491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb852-d4a0-4160-a63d-3d5f68ac314a None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:56.707125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cb852-d4a0-4160-a63d-3d5f68ac314a None admin] RBAC: Adding query filter params (type=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:56.707423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cb852-d4a0-4160-a63d-3d5f68ac314a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:56.708789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cb852-d4a0-4160-a63d-3d5f68ac314a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:56.714728 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 398/780] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:43:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:43:56.723217 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b05a-d7eb-4265-89d6-b85778688b3b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:56.798129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:56.830291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b05a-d7eb-4265-89d6-b85778688b3b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:56.868944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f86a9-8c71-4a8a-8d7c-8bc48359665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:56.869629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f86a9-8c71-4a8a-8d7c-8bc48359665f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:56.869952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f86a9-8c71-4a8a-8d7c-8bc48359665f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:56.870261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f86a9-8c71-4a8a-8d7c-8bc48359665f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:56.871011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f86a9-8c71-4a8a-8d7c-8bc48359665f None admin] RBAC: Adding query filter params (interface=public, service_id=69d7e734a5334c2aa41ce3f75e52ebca, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:56.871324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f86a9-8c71-4a8a-8d7c-8bc48359665f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:56.872691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f86a9-8c71-4a8a-8d7c-8bc48359665f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:56.878325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 383/781] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 08:43:56 2022] GET /identity/v3/endpoints?service_id=69d7e734a5334c2aa41ce3f75e52ebca&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:56.887472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cb852-d4a0-4160-a63d-3d5f68ac314a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:57.000748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cb852-d4a0-4160-a63d-3d5f68ac314a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:57.056599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73c964-e650-4949-9964-3fa75d9bac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:57.057239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73c964-e650-4949-9964-3fa75d9bac06 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:57.057519 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73c964-e650-4949-9964-3fa75d9bac06 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:57.057792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73c964-e650-4949-9964-3fa75d9bac06 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:57.058461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73c964-e650-4949-9964-3fa75d9bac06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:57.059900 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73c964-e650-4949-9964-3fa75d9bac06 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:57.072105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 399/782] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 08:43:56 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:57.094019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f86a9-8c71-4a8a-8d7c-8bc48359665f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:57.219865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f86a9-8c71-4a8a-8d7c-8bc48359665f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:57.237805 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701fa84-9dea-41da-bf56-6cb16f760f7c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:57.238144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701fa84-9dea-41da-bf56-6cb16f760f7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:57.238407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701fa84-9dea-41da-bf56-6cb16f760f7c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:57.240950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 400/783] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:57.245460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb2806-4d5e-4574-8a32-0601ce755c33 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:57.245749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb2806-4d5e-4574-8a32-0601ce755c33 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:57.246018 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb2806-4d5e-4574-8a32-0601ce755c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:57.261434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fa76e-a9b7-4b91-b405-c257532ba8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:57.262357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fa76e-a9b7-4b91-b405-c257532ba8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:57.262640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fa76e-a9b7-4b91-b405-c257532ba8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:57.262913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fa76e-a9b7-4b91-b405-c257532ba8d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:57.265607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6ebb2806-4d5e-4574-8a32-0601ce755c33 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:57.266893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ebb2806-4d5e-4574-8a32-0601ce755c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:57.270439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fa76e-a9b7-4b91-b405-c257532ba8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d94fa76e-a9b7-4b91-b405-c257532ba8d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:57.285492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:57.286586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:57.287480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 384/784] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:57.293848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fa76e-a9b7-4b91-b405-c257532ba8d8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:57.314465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:57.374215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 401/785] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:43:57.406318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fa76e-a9b7-4b91-b405-c257532ba8d8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:57.440624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465203-60d8-4722-9011-250a14d501bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:57.441268 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465203-60d8-4722-9011-250a14d501bc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:57.441506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465203-60d8-4722-9011-250a14d501bc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:57.441761 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465203-60d8-4722-9011-250a14d501bc None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:57.442457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49465203-60d8-4722-9011-250a14d501bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:57.442762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49465203-60d8-4722-9011-250a14d501bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:57.444125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49465203-60d8-4722-9011-250a14d501bc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:57.453297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 385/786] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:57.458572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb2806-4d5e-4574-8a32-0601ce755c33 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:57.586695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb2806-4d5e-4574-8a32-0601ce755c33 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:57.624303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14874c-b7ca-4d7b-b8cc-8371795dbc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:57.625223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14874c-b7ca-4d7b-b8cc-8371795dbc0a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:57.625655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14874c-b7ca-4d7b-b8cc-8371795dbc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:57.626178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14874c-b7ca-4d7b-b8cc-8371795dbc0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:57.637683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14874c-b7ca-4d7b-b8cc-8371795dbc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:57.639435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14874c-b7ca-4d7b-b8cc-8371795dbc0a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bd14874c-b7ca-4d7b-b8cc-8371795dbc0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:57.655362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:57.656532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:57.657647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:57.657647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:57.657647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:57.659447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 402/787] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:57.665402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465203-60d8-4722-9011-250a14d501bc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:57.750802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:57.791651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c5682-5b59-4c0e-a7df-a6e3aa97ac20 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:57.791984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c5682-5b59-4c0e-a7df-a6e3aa97ac20 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:57.792221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c5682-5b59-4c0e-a7df-a6e3aa97ac20 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:57.793779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 403/788] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:57.800069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10977aea-5db1-411b-a0e1-271e686dd7ad None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:57.800359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10977aea-5db1-411b-a0e1-271e686dd7ad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:57.800641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10977aea-5db1-411b-a0e1-271e686dd7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:57.812604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465203-60d8-4722-9011-250a14d501bc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:57.824012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-10977aea-5db1-411b-a0e1-271e686dd7ad None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:57.825277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-10977aea-5db1-411b-a0e1-271e686dd7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:57.835474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:57.850535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9087-60cb-4526-8ed3-1ea7dc0a50d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:57.850535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9087-60cb-4526-8ed3-1ea7dc0a50d7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:57.850760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9087-60cb-4526-8ed3-1ea7dc0a50d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:57.850914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9087-60cb-4526-8ed3-1ea7dc0a50d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:57.852030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9087-60cb-4526-8ed3-1ea7dc0a50d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:57.852335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9087-60cb-4526-8ed3-1ea7dc0a50d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:57.854033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d9087-60cb-4526-8ed3-1ea7dc0a50d7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:57.870817 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 386/789] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:57.872071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9087-60cb-4526-8ed3-1ea7dc0a50d7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:57.908366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 404/790] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:43:57.909999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10977aea-5db1-411b-a0e1-271e686dd7ad None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:57.992478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9087-60cb-4526-8ed3-1ea7dc0a50d7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.019219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:58.050966 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10977aea-5db1-411b-a0e1-271e686dd7ad None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.053026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8a012-dc54-4f09-99ab-748625847994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.053671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8a012-dc54-4f09-99ab-748625847994 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.053951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8a012-dc54-4f09-99ab-748625847994 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.054250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8a012-dc54-4f09-99ab-748625847994 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.077840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8a012-dc54-4f09-99ab-748625847994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f1c8a012-dc54-4f09-99ab-748625847994 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:58.082697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:58.083616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:58.084450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 387/791] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:43:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:58.091749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8a012-dc54-4f09-99ab-748625847994 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.121475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e24df2-be55-46c1-941c-f372bb23de02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.122137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24df2-be55-46c1-941c-f372bb23de02 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.122425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24df2-be55-46c1-941c-f372bb23de02 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.122700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24df2-be55-46c1-941c-f372bb23de02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.133312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e24df2-be55-46c1-941c-f372bb23de02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:58.134808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e24df2-be55-46c1-941c-f372bb23de02 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-67e24df2-be55-46c1-941c-f372bb23de02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:58.154177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:58.155132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:43:58.156054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:58.156574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 405/792] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:58.164730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e24df2-be55-46c1-941c-f372bb23de02 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.178403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:58.278179 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8a012-dc54-4f09-99ab-748625847994 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.301243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e24df2-be55-46c1-941c-f372bb23de02 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.323860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43952087-9987-4346-b0f9-1af16db29ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.324566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43952087-9987-4346-b0f9-1af16db29ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.325019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43952087-9987-4346-b0f9-1af16db29ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.325518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43952087-9987-4346-b0f9-1af16db29ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.326376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43952087-9987-4346-b0f9-1af16db29ba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:58.326852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43952087-9987-4346-b0f9-1af16db29ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:58.329286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43952087-9987-4346-b0f9-1af16db29ba0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:58.336810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee8b45-a8fa-42f6-b06c-9fe35cd2698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.337500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee8b45-a8fa-42f6-b06c-9fe35cd2698f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.337851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee8b45-a8fa-42f6-b06c-9fe35cd2698f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.338238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee8b45-a8fa-42f6-b06c-9fe35cd2698f None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.339041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee8b45-a8fa-42f6-b06c-9fe35cd2698f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:58.339545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee8b45-a8fa-42f6-b06c-9fe35cd2698f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:58.339946 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 388/793] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:58.340897 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43952087-9987-4346-b0f9-1af16db29ba0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.341262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee8b45-a8fa-42f6-b06c-9fe35cd2698f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:58.361755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 406/794] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:58.366307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee8b45-a8fa-42f6-b06c-9fe35cd2698f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.403807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:58.433609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:58.475606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43952087-9987-4346-b0f9-1af16db29ba0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.477275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee8b45-a8fa-42f6-b06c-9fe35cd2698f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.514760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b962cf-2910-425b-a560-24342ee2485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.515503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b962cf-2910-425b-a560-24342ee2485e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.515842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b962cf-2910-425b-a560-24342ee2485e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.516130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b962cf-2910-425b-a560-24342ee2485e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.517476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9967d7-9ba7-4621-bb1f-6fc0459b2e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.518463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9967d7-9ba7-4621-bb1f-6fc0459b2e5e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.519066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9967d7-9ba7-4621-bb1f-6fc0459b2e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.519549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9967d7-9ba7-4621-bb1f-6fc0459b2e5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.527467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b962cf-2910-425b-a560-24342ee2485e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:58.529083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b962cf-2910-425b-a560-24342ee2485e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:58.531248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9967d7-9ba7-4621-bb1f-6fc0459b2e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9b9967d7-9ba7-4621-bb1f-6fc0459b2e5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:43:58.539294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:58.540242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:43:58.541078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:58.543804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 389/795] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-75b962cf-2910-425b-a560-24342ee2485e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:58.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:58.544803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:58.545682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:58.545682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:58.545682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:58.547124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9967d7-9ba7-4621-bb1f-6fc0459b2e5e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.549800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 407/796] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:58.550671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b962cf-2910-425b-a560-24342ee2485e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.661406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b962cf-2910-425b-a560-24342ee2485e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.663675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:58.668226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9967d7-9ba7-4621-bb1f-6fc0459b2e5e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.677898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:58.699390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f1b02-20e8-4963-818c-64262eec96fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.700339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f1b02-20e8-4963-818c-64262eec96fe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.700339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f1b02-20e8-4963-818c-64262eec96fe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.700705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f1b02-20e8-4963-818c-64262eec96fe None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.701495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f1b02-20e8-4963-818c-64262eec96fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:58.702320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f1b02-20e8-4963-818c-64262eec96fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:58.704699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f1b02-20e8-4963-818c-64262eec96fe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:58.709856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c44020-1ff9-4f1e-9281-9ae4947d0ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.711230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c44020-1ff9-4f1e-9281-9ae4947d0ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.711765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c44020-1ff9-4f1e-9281-9ae4947d0ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.712191 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c44020-1ff9-4f1e-9281-9ae4947d0ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.714989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 408/797] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:58.716107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f1b02-20e8-4963-818c-64262eec96fe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.724406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c44020-1ff9-4f1e-9281-9ae4947d0ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:58.726205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c44020-1ff9-4f1e-9281-9ae4947d0ac1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-51c44020-1ff9-4f1e-9281-9ae4947d0ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:58.746157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:58.747133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:58.748029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:58.748029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:58.748029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:58.754854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 390/798] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:58.756363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c44020-1ff9-4f1e-9281-9ae4947d0ac1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.843224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f1b02-20e8-4963-818c-64262eec96fe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.875775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c44020-1ff9-4f1e-9281-9ae4947d0ac1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:58.888963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541e49c-7910-47ca-9dbc-b4514fc11629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.890226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541e49c-7910-47ca-9dbc-b4514fc11629 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.890699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541e49c-7910-47ca-9dbc-b4514fc11629 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.891421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541e49c-7910-47ca-9dbc-b4514fc11629 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.892271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541e49c-7910-47ca-9dbc-b4514fc11629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:58.892796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541e49c-7910-47ca-9dbc-b4514fc11629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:58.895119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541e49c-7910-47ca-9dbc-b4514fc11629 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:58.917675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 409/799] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:58.917675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541e49c-7910-47ca-9dbc-b4514fc11629 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.932572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580028fa-48bd-4b2e-a8c3-e2233f46c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:58.933260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580028fa-48bd-4b2e-a8c3-e2233f46c07f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:58.936643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580028fa-48bd-4b2e-a8c3-e2233f46c07f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:58.936932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580028fa-48bd-4b2e-a8c3-e2233f46c07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:58.949312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580028fa-48bd-4b2e-a8c3-e2233f46c07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:58.950820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580028fa-48bd-4b2e-a8c3-e2233f46c07f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:58.967420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-580028fa-48bd-4b2e-a8c3-e2233f46c07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:58.967808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:58.968708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:58.969593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:58.969593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:58.969593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:58.969593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 391/800] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:58.970330 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580028fa-48bd-4b2e-a8c3-e2233f46c07f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:58.974755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:59.048346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541e49c-7910-47ca-9dbc-b4514fc11629 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.080676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580028fa-48bd-4b2e-a8c3-e2233f46c07f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.082516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c0f7f-b6b1-4296-8e75-b7f7dd66f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.083133 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c0f7f-b6b1-4296-8e75-b7f7dd66f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.083416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c0f7f-b6b1-4296-8e75-b7f7dd66f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.083692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c0f7f-b6b1-4296-8e75-b7f7dd66f1a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.084338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c0f7f-b6b1-4296-8e75-b7f7dd66f1a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:59.084647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c0f7f-b6b1-4296-8e75-b7f7dd66f1a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.086574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c0f7f-b6b1-4296-8e75-b7f7dd66f1a0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.102767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 410/801] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:59.102767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c0f7f-b6b1-4296-8e75-b7f7dd66f1a0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.121306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87dfcc8-989b-4ae6-9096-b434ed9f3ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.122026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dfcc8-989b-4ae6-9096-b434ed9f3ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.122349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dfcc8-989b-4ae6-9096-b434ed9f3ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.122633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87dfcc8-989b-4ae6-9096-b434ed9f3ee4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.130282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dfcc8-989b-4ae6-9096-b434ed9f3ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.131754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87dfcc8-989b-4ae6-9096-b434ed9f3ee4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d87dfcc8-989b-4ae6-9096-b434ed9f3ee4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:59.142818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:59.143765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:59.144713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 392/802] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:43:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:59.145296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b30d16-ab6f-4b2e-b17e-1badd8fdf63f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.145365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b30d16-ab6f-4b2e-b17e-1badd8fdf63f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.145943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b30d16-ab6f-4b2e-b17e-1badd8fdf63f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.151482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 393/803] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:59.151482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b30d16-ab6f-4b2e-b17e-1badd8fdf63f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.200808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:59.206618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c0f7f-b6b1-4296-8e75-b7f7dd66f1a0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.218164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:59.242793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd82553-bebf-4bc0-bedf-f9d73bc10061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.243532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd82553-bebf-4bc0-bedf-f9d73bc10061 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.243820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd82553-bebf-4bc0-bedf-f9d73bc10061 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.244274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd82553-bebf-4bc0-bedf-f9d73bc10061 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.244774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd82553-bebf-4bc0-bedf-f9d73bc10061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:59.245084 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd82553-bebf-4bc0-bedf-f9d73bc10061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.246547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd82553-bebf-4bc0-bedf-f9d73bc10061 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.259696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b30d16-ab6f-4b2e-b17e-1badd8fdf63f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.261501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 411/804] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:59.263636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd82553-bebf-4bc0-bedf-f9d73bc10061 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.296754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a681c-4b3c-4125-ac16-1baeb31d4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.297396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a681c-4b3c-4125-ac16-1baeb31d4d88 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.297676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a681c-4b3c-4125-ac16-1baeb31d4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.297947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a681c-4b3c-4125-ac16-1baeb31d4d88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.305244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a681c-4b3c-4125-ac16-1baeb31d4d88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.306748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a681c-4b3c-4125-ac16-1baeb31d4d88 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5f3a681c-4b3c-4125-ac16-1baeb31d4d88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:43:59.318784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:59.319677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 394/805] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe04f6a-759d-4346-ae72-4be52a6a82eb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.325575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe04f6a-759d-4346-ae72-4be52a6a82eb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.326251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe04f6a-759d-4346-ae72-4be52a6a82eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.340461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5fe04f6a-759d-4346-ae72-4be52a6a82eb None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:59.341677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5fe04f6a-759d-4346-ae72-4be52a6a82eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:59.377302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd82553-bebf-4bc0-bedf-f9d73bc10061 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.413823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a91e9d-b12b-4c31-b978-48414351185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.414466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91e9d-b12b-4c31-b978-48414351185c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.414751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91e9d-b12b-4c31-b978-48414351185c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.415035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a91e9d-b12b-4c31-b978-48414351185c None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.415778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a91e9d-b12b-4c31-b978-48414351185c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:59.416090 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a91e9d-b12b-4c31-b978-48414351185c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.417533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a91e9d-b12b-4c31-b978-48414351185c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.426292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 395/806] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:43:59.426292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe04f6a-759d-4346-ae72-4be52a6a82eb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.450243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 412/807] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:59.451179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a91e9d-b12b-4c31-b978-48414351185c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.467972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:59.485783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:59.532138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe04f6a-759d-4346-ae72-4be52a6a82eb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.573371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce784086-15cd-4159-9fac-cf06602deb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.574242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce784086-15cd-4159-9fac-cf06602deb45 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.574634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce784086-15cd-4159-9fac-cf06602deb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.575014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce784086-15cd-4159-9fac-cf06602deb45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.579496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a91e9d-b12b-4c31-b978-48414351185c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.583470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce784086-15cd-4159-9fac-cf06602deb45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.585023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce784086-15cd-4159-9fac-cf06602deb45 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ce784086-15cd-4159-9fac-cf06602deb45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:43:59.597361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:59.598388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:43:59.599354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:59.604783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 396/808] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:59.604982 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce784086-15cd-4159-9fac-cf06602deb45 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.628321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02908-3a86-4318-9bed-0579cea32299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.629291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02908-3a86-4318-9bed-0579cea32299 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.629777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02908-3a86-4318-9bed-0579cea32299 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.630323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc02908-3a86-4318-9bed-0579cea32299 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.631221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02908-3a86-4318-9bed-0579cea32299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:59.631726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02908-3a86-4318-9bed-0579cea32299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.633467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc02908-3a86-4318-9bed-0579cea32299 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.654896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 413/809] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:59.654896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02908-3a86-4318-9bed-0579cea32299 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.725426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce784086-15cd-4159-9fac-cf06602deb45 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.736606 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:59.740193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:59.760188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f308205-652c-4d16-a4ca-978a5cb956cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.760440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc02908-3a86-4318-9bed-0579cea32299 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.760825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f308205-652c-4d16-a4ca-978a5cb956cd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.761108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f308205-652c-4d16-a4ca-978a5cb956cd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.761406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f308205-652c-4d16-a4ca-978a5cb956cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.771630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f308205-652c-4d16-a4ca-978a5cb956cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.773590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f308205-652c-4d16-a4ca-978a5cb956cd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3f308205-652c-4d16-a4ca-978a5cb956cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:43:59.788021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:59.789715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:43:59.790803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:43:59.790803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:43:59.790803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:43:59.790803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 397/810] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:59.790803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f308205-652c-4d16-a4ca-978a5cb956cd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.799256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276e25b-4d14-4790-b2c7-54d4d89be04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.799906 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276e25b-4d14-4790-b2c7-54d4d89be04a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.800602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276e25b-4d14-4790-b2c7-54d4d89be04a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.800942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276e25b-4d14-4790-b2c7-54d4d89be04a None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.801745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276e25b-4d14-4790-b2c7-54d4d89be04a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:43:59.802437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276e25b-4d14-4790-b2c7-54d4d89be04a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.804207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276e25b-4d14-4790-b2c7-54d4d89be04a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.821435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 414/811] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:43:59.822853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a604-c15c-4412-8f07-08d7c0c8251a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.823149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a604-c15c-4412-8f07-08d7c0c8251a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.823431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a604-c15c-4412-8f07-08d7c0c8251a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.826269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 415/812] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:59.826269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216a604-c15c-4412-8f07-08d7c0c8251a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.891715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f308205-652c-4d16-a4ca-978a5cb956cd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.924140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8e6fd-dfeb-414b-b8f5-7ee1df41da0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.924796 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8e6fd-dfeb-414b-b8f5-7ee1df41da0b None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.925082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8e6fd-dfeb-414b-b8f5-7ee1df41da0b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.925361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8e6fd-dfeb-414b-b8f5-7ee1df41da0b None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/88353e858ec64a9cbdcfd16dbc00ebe3/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.926169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216a604-c15c-4412-8f07-08d7c0c8251a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:59.927426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8e6fd-dfeb-414b-b8f5-7ee1df41da0b None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=88353e858ec64a9cbdcfd16dbc00ebe3, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.928883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8e6fd-dfeb-414b-b8f5-7ee1df41da0b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.958328 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:59.963231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e937250-5727-4b26-83c1-d70b58a577d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:59.963859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e937250-5727-4b26-83c1-d70b58a577d4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.964144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e937250-5727-4b26-83c1-d70b58a577d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.964421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e937250-5727-4b26-83c1-d70b58a577d4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.965015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e937250-5727-4b26-83c1-d70b58a577d4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:59.966590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e937250-5727-4b26-83c1-d70b58a577d4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4e937250-5727-4b26-83c1-d70b58a577d4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:43:59.975513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:43:59.976643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:43:59.977479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 416/813] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:43:59.978403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e937250-5727-4b26-83c1-d70b58a577d4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:59.998455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 398/814] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:43:59 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/88353e858ec64a9cbdcfd16dbc00ebe3/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:43:59.999433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8e6fd-dfeb-414b-b8f5-7ee1df41da0b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.030895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:00.089917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e937250-5727-4b26-83c1-d70b58a577d4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.130415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536b5a-c37f-4124-bdb5-35a68168e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.131062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536b5a-c37f-4124-bdb5-35a68168e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.131367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536b5a-c37f-4124-bdb5-35a68168e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.131622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536b5a-c37f-4124-bdb5-35a68168e7d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.132315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536b5a-c37f-4124-bdb5-35a68168e7d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:00.132676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536b5a-c37f-4124-bdb5-35a68168e7d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:00.134263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536b5a-c37f-4124-bdb5-35a68168e7d5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:00.153151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 417/815] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:00.153151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f0273-705e-47ea-b3fb-eff3cedbe398 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.153151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f0273-705e-47ea-b3fb-eff3cedbe398 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.153151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f0273-705e-47ea-b3fb-eff3cedbe398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.171164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-414f0273-705e-47ea-b3fb-eff3cedbe398 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:00.172409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-414f0273-705e-47ea-b3fb-eff3cedbe398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:00.228424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8e6fd-dfeb-414b-b8f5-7ee1df41da0b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.231574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:00.249364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 418/816] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:00.250345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f0273-705e-47ea-b3fb-eff3cedbe398 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.271986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5c80-fa17-4b52-962a-19d63ca6112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.273200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5c80-fa17-4b52-962a-19d63ca6112a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.273634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5c80-fa17-4b52-962a-19d63ca6112a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.274231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5c80-fa17-4b52-962a-19d63ca6112a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.354608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f0273-705e-47ea-b3fb-eff3cedbe398 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.366048 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5c80-fa17-4b52-962a-19d63ca6112a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:00.368911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5c80-fa17-4b52-962a-19d63ca6112a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:00.391005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc99e46-a110-49b9-881e-948041cc4ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.391618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc99e46-a110-49b9-881e-948041cc4ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.391899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc99e46-a110-49b9-881e-948041cc4ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.392171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc99e46-a110-49b9-881e-948041cc4ab1 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.392808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc99e46-a110-49b9-881e-948041cc4ab1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:00.393113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc99e46-a110-49b9-881e-948041cc4ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:00.394524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc99e46-a110-49b9-881e-948041cc4ab1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:00.399374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 419/817] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 08:44:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:00.399980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc99e46-a110-49b9-881e-948041cc4ab1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.405294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:00.451983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:00.506430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc99e46-a110-49b9-881e-948041cc4ab1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.508273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 399/818] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:43:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:00.510546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5c80-fa17-4b52-962a-19d63ca6112a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.543001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7ce54-5538-4ad8-b95d-dd3726af81b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.543640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7ce54-5538-4ad8-b95d-dd3726af81b5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.543926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7ce54-5538-4ad8-b95d-dd3726af81b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.544204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7ce54-5538-4ad8-b95d-dd3726af81b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.551150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7ce54-5538-4ad8-b95d-dd3726af81b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:00.552621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7ce54-5538-4ad8-b95d-dd3726af81b5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4ad7ce54-5538-4ad8-b95d-dd3726af81b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:00.564255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:00.565167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:00.566127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:00.566127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:00.566127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:00.566127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:00.566127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:00.566127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:00.566127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:00.566127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:00.570136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 420/819] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:00.571082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7ce54-5538-4ad8-b95d-dd3726af81b5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.632013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5c80-fa17-4b52-962a-19d63ca6112a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.659216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:00.668512 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa2a57-0e01-4d6d-8299-123a18a53f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.669126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa2a57-0e01-4d6d-8299-123a18a53f87 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.669407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa2a57-0e01-4d6d-8299-123a18a53f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.672020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa2a57-0e01-4d6d-8299-123a18a53f87 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.672020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa2a57-0e01-4d6d-8299-123a18a53f87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:00.672020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa2a57-0e01-4d6d-8299-123a18a53f87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:00.672020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa2a57-0e01-4d6d-8299-123a18a53f87 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:00.677017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 400/820] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Oct 4 08:44:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:00.677721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa2a57-0e01-4d6d-8299-123a18a53f87 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.685507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7ce54-5538-4ad8-b95d-dd3726af81b5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.696918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:00.720819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba4e78-9ddd-4f1a-b6de-2ed057a91998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.721455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba4e78-9ddd-4f1a-b6de-2ed057a91998 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.721737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba4e78-9ddd-4f1a-b6de-2ed057a91998 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.722011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba4e78-9ddd-4f1a-b6de-2ed057a91998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.735028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba4e78-9ddd-4f1a-b6de-2ed057a91998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:00.736525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba4e78-9ddd-4f1a-b6de-2ed057a91998 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1cba4e78-9ddd-4f1a-b6de-2ed057a91998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:00.752041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:00.753015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:00.753891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:00.753891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:00.753891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:00.753891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 421/821] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:00.754138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba4e78-9ddd-4f1a-b6de-2ed057a91998 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.792827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa2a57-0e01-4d6d-8299-123a18a53f87 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.829851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd6bc8-b0ab-48c3-bbbf-f79ee28eec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.830543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd6bc8-b0ab-48c3-bbbf-f79ee28eec95 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.830843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd6bc8-b0ab-48c3-bbbf-f79ee28eec95 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.831098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd6bc8-b0ab-48c3-bbbf-f79ee28eec95 None admin] PATH_INFO: `/v3/services/network` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.831685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd6bc8-b0ab-48c3-bbbf-f79ee28eec95 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:00.834118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd6bc8-b0ab-48c3-bbbf-f79ee28eec95 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f8dd6bc8-b0ab-48c3-bbbf-f79ee28eec95 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:00.844543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:00.845498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:00.846347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 401/822] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:00 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:00.847132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd6bc8-b0ab-48c3-bbbf-f79ee28eec95 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.870056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba4e78-9ddd-4f1a-b6de-2ed057a91998 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.908200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:00.909896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a60b6-aa36-40c8-a0e2-e38c5e46558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.910818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a60b6-aa36-40c8-a0e2-e38c5e46558b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.911109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a60b6-aa36-40c8-a0e2-e38c5e46558b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.911385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a60b6-aa36-40c8-a0e2-e38c5e46558b None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.912637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a60b6-aa36-40c8-a0e2-e38c5e46558b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:00.912953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a60b6-aa36-40c8-a0e2-e38c5e46558b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:00.918149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a60b6-aa36-40c8-a0e2-e38c5e46558b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:00.935961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 422/823] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:00.935961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a60b6-aa36-40c8-a0e2-e38c5e46558b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.960086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:00.963546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd6bc8-b0ab-48c3-bbbf-f79ee28eec95 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.998957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405e50d-24ef-4b9b-8652-9371160fd48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.999888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405e50d-24ef-4b9b-8652-9371160fd48c None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:01.000427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405e50d-24ef-4b9b-8652-9371160fd48c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:01.000949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405e50d-24ef-4b9b-8652-9371160fd48c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:01.001865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405e50d-24ef-4b9b-8652-9371160fd48c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:01.003480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405e50d-24ef-4b9b-8652-9371160fd48c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:01.034866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a60b6-aa36-40c8-a0e2-e38c5e46558b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:01.069037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5938-213f-47ec-900c-ddc4fc6e8b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:01.069605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5938-213f-47ec-900c-ddc4fc6e8b5b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:01.070564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5938-213f-47ec-900c-ddc4fc6e8b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:01.070848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5938-213f-47ec-900c-ddc4fc6e8b5b None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:01.071498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff5938-213f-47ec-900c-ddc4fc6e8b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:01.071805 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff5938-213f-47ec-900c-ddc4fc6e8b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:01.073226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff5938-213f-47ec-900c-ddc4fc6e8b5b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:01.084572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 423/824] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:01.088474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5938-213f-47ec-900c-ddc4fc6e8b5b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:01.114388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 402/825] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:44:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:01.115457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405e50d-24ef-4b9b-8652-9371160fd48c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:01.186475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:01.208167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5938-213f-47ec-900c-ddc4fc6e8b5b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:01.260373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc61d63-1051-4430-8362-4b9716509d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:01.261183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc61d63-1051-4430-8362-4b9716509d2a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:01.261564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc61d63-1051-4430-8362-4b9716509d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:01.261939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc61d63-1051-4430-8362-4b9716509d2a None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:01.262748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc61d63-1051-4430-8362-4b9716509d2a None admin] RBAC: Adding query filter params (name=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:01.263190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc61d63-1051-4430-8362-4b9716509d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:01.265008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc61d63-1051-4430-8362-4b9716509d2a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:01.266318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405e50d-24ef-4b9b-8652-9371160fd48c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:01.272399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 424/826] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:44:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:01.273509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc61d63-1051-4430-8362-4b9716509d2a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:01.276162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:01.306346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde796fa-980d-4202-9244-7a0ecede71a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:01.307638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde796fa-980d-4202-9244-7a0ecede71a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:01.308289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde796fa-980d-4202-9244-7a0ecede71a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:01.308887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde796fa-980d-4202-9244-7a0ecede71a3 None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/afdc2662bd3148e3b120427adcc1a12b/roles/a53d956761a64b18a7d7e76cbef98222` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:01.325864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde796fa-980d-4202-9244-7a0ecede71a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=afdc2662bd3148e3b120427adcc1a12b, role_id=a53d956761a64b18a7d7e76cbef98222)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:01.327314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde796fa-980d-4202-9244-7a0ecede71a3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:01.396613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc61d63-1051-4430-8362-4b9716509d2a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:01.431961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4239eb-f488-4228-bde5-238cbdbb7979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:01.432584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4239eb-f488-4228-bde5-238cbdbb7979 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:01.432873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4239eb-f488-4228-bde5-238cbdbb7979 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:01.433153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4239eb-f488-4228-bde5-238cbdbb7979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:01.440434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 403/827] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:44:01 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/afdc2662bd3148e3b120427adcc1a12b/roles/a53d956761a64b18a7d7e76cbef98222 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:44:01.446219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde796fa-980d-4202-9244-7a0ecede71a3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:01.462944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4239eb-f488-4228-bde5-238cbdbb7979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:01.464536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4239eb-f488-4228-bde5-238cbdbb7979 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1d4239eb-f488-4228-bde5-238cbdbb7979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:01.488257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:01.489242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:01.490183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:01.490183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:01.490183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:01.490183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:01.490183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:01.490183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:01.490183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:01.490183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:01.491114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 425/828] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:01.498408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4239eb-f488-4228-bde5-238cbdbb7979 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:01.503562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:01.647356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4239eb-f488-4228-bde5-238cbdbb7979 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:01.655292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde796fa-980d-4202-9244-7a0ecede71a3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:01.689752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a26e-0c91-48c3-b4da-dcc93e5f3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:01.691099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a26e-0c91-48c3-b4da-dcc93e5f3d19 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:01.691686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a26e-0c91-48c3-b4da-dcc93e5f3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:01.692214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455a26e-0c91-48c3-b4da-dcc93e5f3d19 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:01.693090 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455a26e-0c91-48c3-b4da-dcc93e5f3d19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:01.693218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03896ef-b773-49c5-9ae9-7619115dbe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:01.693727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455a26e-0c91-48c3-b4da-dcc93e5f3d19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:01.693831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03896ef-b773-49c5-9ae9-7619115dbe1c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:01.694203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03896ef-b773-49c5-9ae9-7619115dbe1c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:01.694562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03896ef-b773-49c5-9ae9-7619115dbe1c None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:01.695802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03896ef-b773-49c5-9ae9-7619115dbe1c None admin] RBAC: Adding query filter params (type=network) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:01.696175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03896ef-b773-49c5-9ae9-7619115dbe1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:01.696793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455a26e-0c91-48c3-b4da-dcc93e5f3d19 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:01.697671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03896ef-b773-49c5-9ae9-7619115dbe1c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:01.704879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 404/829] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:44:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:01.713941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03896ef-b773-49c5-9ae9-7619115dbe1c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:01.714145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 426/830] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:01.721557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a26e-0c91-48c3-b4da-dcc93e5f3d19 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:01.746828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:01.806470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:01.862473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03896ef-b773-49c5-9ae9-7619115dbe1c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:01.882910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455a26e-0c91-48c3-b4da-dcc93e5f3d19 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:01.938184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006cbeb-5f71-48af-9c05-e2a0d9535a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:01.938184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006cbeb-5f71-48af-9c05-e2a0d9535a1e None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:01.938521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006cbeb-5f71-48af-9c05-e2a0d9535a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:01.938716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006cbeb-5f71-48af-9c05-e2a0d9535a1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:01.939402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006cbeb-5f71-48af-9c05-e2a0d9535a1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:01.940783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006cbeb-5f71-48af-9c05-e2a0d9535a1e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:01.950514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5cc70-c5e6-41fb-b1d0-f5fa35dd36d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:01.951130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5cc70-c5e6-41fb-b1d0-f5fa35dd36d1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:01.951411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5cc70-c5e6-41fb-b1d0-f5fa35dd36d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:01.951684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5cc70-c5e6-41fb-b1d0-f5fa35dd36d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:01.952424 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5cc70-c5e6-41fb-b1d0-f5fa35dd36d1 None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=9f31f738fe094e4ea7ed440e661e2111) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:01.952737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5cc70-c5e6-41fb-b1d0-f5fa35dd36d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:01.954201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5cc70-c5e6-41fb-b1d0-f5fa35dd36d1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:01.965177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 427/831] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:01 2022] GET /identity/v3/role_assignments?user.id=9f31f738fe094e4ea7ed440e661e2111&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:02.040373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 405/832] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:44:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:02.237949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d65e59-81ae-4438-932a-0d52b6cc5f57 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:02.238150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d65e59-81ae-4438-932a-0d52b6cc5f57 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:02.238451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d65e59-81ae-4438-932a-0d52b6cc5f57 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:02.240020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 428/833] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:02.246056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61daaf-3d23-4cad-a39a-4c17891bbf56 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:02.246379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61daaf-3d23-4cad-a39a-4c17891bbf56 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:02.246659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61daaf-3d23-4cad-a39a-4c17891bbf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:02.272021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7d61daaf-3d23-4cad-a39a-4c17891bbf56 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:02.273775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7d61daaf-3d23-4cad-a39a-4c17891bbf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:02.365246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 406/834] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:02.636528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d65e59-81ae-4438-932a-0d52b6cc5f57 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:02.738318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d65e59-81ae-4438-932a-0d52b6cc5f57 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:02.768194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:02.777043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ef810-98d6-4b83-8dd8-5b2d0b7c4625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:02.777672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ef810-98d6-4b83-8dd8-5b2d0b7c4625 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:02.783756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ef810-98d6-4b83-8dd8-5b2d0b7c4625 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:02.783756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ef810-98d6-4b83-8dd8-5b2d0b7c4625 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:02.789277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ef810-98d6-4b83-8dd8-5b2d0b7c4625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f21ef810-98d6-4b83-8dd8-5b2d0b7c4625 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:02.794105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:02.795026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:02.796049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 429/835] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:02.801148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61daaf-3d23-4cad-a39a-4c17891bbf56 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:02.803387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:02.904526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61daaf-3d23-4cad-a39a-4c17891bbf56 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:02.951650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a831-6b81-4aed-91a2-2cb616a0e7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:02.952266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a831-6b81-4aed-91a2-2cb616a0e7bd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:02.952548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a831-6b81-4aed-91a2-2cb616a0e7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:02.952875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a831-6b81-4aed-91a2-2cb616a0e7bd None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:02.953545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035a831-6b81-4aed-91a2-2cb616a0e7bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:02.953848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035a831-6b81-4aed-91a2-2cb616a0e7bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:02.955245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035a831-6b81-4aed-91a2-2cb616a0e7bd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:02.964164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 407/836] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:02.969976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ef810-98d6-4b83-8dd8-5b2d0b7c4625 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:03.072320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ef810-98d6-4b83-8dd8-5b2d0b7c4625 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:03.107313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7a067-d1f2-4bb4-b047-29871e6c7d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:03.108117 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7a067-d1f2-4bb4-b047-29871e6c7d87 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.108318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7a067-d1f2-4bb4-b047-29871e6c7d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.108473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7a067-d1f2-4bb4-b047-29871e6c7d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.119224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7a067-d1f2-4bb4-b047-29871e6c7d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:03.120659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7a067-d1f2-4bb4-b047-29871e6c7d87 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-eef7a067-d1f2-4bb4-b047-29871e6c7d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:03.135444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:03.137750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:03.140107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:03.140107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:03.140107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:03.140107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 430/837] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:03.142384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a831-6b81-4aed-91a2-2cb616a0e7bd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:03.208745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:03.247905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a831-6b81-4aed-91a2-2cb616a0e7bd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:03.281968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be8c77-8a82-4a1e-965e-776dea7a4569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:03.282599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8c77-8a82-4a1e-965e-776dea7a4569 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.282872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8c77-8a82-4a1e-965e-776dea7a4569 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.283139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8c77-8a82-4a1e-965e-776dea7a4569 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.283784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be8c77-8a82-4a1e-965e-776dea7a4569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:03.284105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be8c77-8a82-4a1e-965e-776dea7a4569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:03.285494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be8c77-8a82-4a1e-965e-776dea7a4569 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:03.297954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 408/838] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:03.303408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7a067-d1f2-4bb4-b047-29871e6c7d87 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:03.344078 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:03.405264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7a067-d1f2-4bb4-b047-29871e6c7d87 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:03.443102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a219927-0a04-49dc-ac5d-a9aee1644b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:03.443761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a219927-0a04-49dc-ac5d-a9aee1644b14 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.444040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a219927-0a04-49dc-ac5d-a9aee1644b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.444313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a219927-0a04-49dc-ac5d-a9aee1644b14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.453372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a219927-0a04-49dc-ac5d-a9aee1644b14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:03.454887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a219927-0a04-49dc-ac5d-a9aee1644b14 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6a219927-0a04-49dc-ac5d-a9aee1644b14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:44:03.468836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:03.469815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:03.471234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 431/839] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:44:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:03.475520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be8c77-8a82-4a1e-965e-776dea7a4569 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:03.566596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39c214-08a4-4e19-8001-c93c36fa99be None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.566896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39c214-08a4-4e19-8001-c93c36fa99be None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.567144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39c214-08a4-4e19-8001-c93c36fa99be None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.568701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 432/840] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:03.576047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4c9b-fafe-44ad-955e-56782c35963e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.576575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4c9b-fafe-44ad-955e-56782c35963e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.577428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4c9b-fafe-44ad-955e-56782c35963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.583327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be8c77-8a82-4a1e-965e-776dea7a4569 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:03.597842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7c4d4c9b-fafe-44ad-955e-56782c35963e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:03.599407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7c4d4c9b-fafe-44ad-955e-56782c35963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:03.609205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:03.621438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf41c89-557b-43c3-b121-5991407ba9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:03.625271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf41c89-557b-43c3-b121-5991407ba9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.625271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf41c89-557b-43c3-b121-5991407ba9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.625271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf41c89-557b-43c3-b121-5991407ba9b3 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.625271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf41c89-557b-43c3-b121-5991407ba9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:03.625271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf41c89-557b-43c3-b121-5991407ba9b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:03.625271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf41c89-557b-43c3-b121-5991407ba9b3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:03.645205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 409/841] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Oct 4 08:44:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:03.650951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf41c89-557b-43c3-b121-5991407ba9b3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:03.691780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 433/842] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:03.762690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf41c89-557b-43c3-b121-5991407ba9b3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:03.798366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b879c52-9d05-411c-aec3-5c60aae9c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:03.798976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b879c52-9d05-411c-aec3-5c60aae9c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.799251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b879c52-9d05-411c-aec3-5c60aae9c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.799519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b879c52-9d05-411c-aec3-5c60aae9c9c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.854486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:03.862989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6668-c532-4f81-922e-4564dace10f7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.863443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6668-c532-4f81-922e-4564dace10f7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.863523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6668-c532-4f81-922e-4564dace10f7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.865095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 434/843] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:03.869918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eed9c-4ad0-42d6-915a-50cc3295457b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:03.871245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eed9c-4ad0-42d6-915a-50cc3295457b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:03.871245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eed9c-4ad0-42d6-915a-50cc3295457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:03.877736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b879c52-9d05-411c-aec3-5c60aae9c9c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:03.879333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b879c52-9d05-411c-aec3-5c60aae9c9c6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:03.891988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d88eed9c-4ad0-42d6-915a-50cc3295457b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:03.893475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d88eed9c-4ad0-42d6-915a-50cc3295457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:03.921746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:03.990558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 410/844] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:44:03.991228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 435/845] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:03.999090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b879c52-9d05-411c-aec3-5c60aae9c9c6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.017287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eed9c-4ad0-42d6-915a-50cc3295457b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.086230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:04.106329 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b879c52-9d05-411c-aec3-5c60aae9c9c6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.141758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0496-642c-4ed2-8d2d-99b37f596063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.142782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0496-642c-4ed2-8d2d-99b37f596063 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.143277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0496-642c-4ed2-8d2d-99b37f596063 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.143751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a0496-642c-4ed2-8d2d-99b37f596063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.150291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eed9c-4ad0-42d6-915a-50cc3295457b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.155431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a0496-642c-4ed2-8d2d-99b37f596063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.157126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a0496-642c-4ed2-8d2d-99b37f596063 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a31a0496-642c-4ed2-8d2d-99b37f596063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:04.173480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:04.174708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:04.175596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:04.175596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:04.175596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:04.177604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 411/846] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:04.183263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0496-642c-4ed2-8d2d-99b37f596063 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.192193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c997d8e-531a-40d0-a624-31e5a8979a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.192839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c997d8e-531a-40d0-a624-31e5a8979a87 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.193124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c997d8e-531a-40d0-a624-31e5a8979a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.193434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c997d8e-531a-40d0-a624-31e5a8979a87 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.194567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c997d8e-531a-40d0-a624-31e5a8979a87 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.196916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c997d8e-531a-40d0-a624-31e5a8979a87 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4c997d8e-531a-40d0-a624-31e5a8979a87 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:04.209178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:04.210190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:44:04.211563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:04.214152 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 436/847] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:04.216711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c997d8e-531a-40d0-a624-31e5a8979a87 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.251558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:04.295373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a0496-642c-4ed2-8d2d-99b37f596063 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.332969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f470-ac2b-45ae-a970-cfc5bdb81865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.333882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f470-ac2b-45ae-a970-cfc5bdb81865 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.334269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f470-ac2b-45ae-a970-cfc5bdb81865 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.334545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f470-ac2b-45ae-a970-cfc5bdb81865 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.335189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f470-ac2b-45ae-a970-cfc5bdb81865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:04.335523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f470-ac2b-45ae-a970-cfc5bdb81865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.336927 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f470-ac2b-45ae-a970-cfc5bdb81865 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.337733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c997d8e-531a-40d0-a624-31e5a8979a87 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.338535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:04.354239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 412/848] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:04.354239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f470-ac2b-45ae-a970-cfc5bdb81865 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.383492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a6848-859b-41d2-b761-a2411c8f7cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.384101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a6848-859b-41d2-b761-a2411c8f7cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.384399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a6848-859b-41d2-b761-a2411c8f7cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.384658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a6848-859b-41d2-b761-a2411c8f7cb2 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.385299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a6848-859b-41d2-b761-a2411c8f7cb2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:04.385596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a6848-859b-41d2-b761-a2411c8f7cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.387000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a6848-859b-41d2-b761-a2411c8f7cb2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.391430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 437/849] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:04.392210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a6848-859b-41d2-b761-a2411c8f7cb2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.463185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f470-ac2b-45ae-a970-cfc5bdb81865 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.486139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:04.500728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa87acc-a408-43e8-988d-29823e06dfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.506366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a6848-859b-41d2-b761-a2411c8f7cb2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.506479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa87acc-a408-43e8-988d-29823e06dfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.506479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa87acc-a408-43e8-988d-29823e06dfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.506479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa87acc-a408-43e8-988d-29823e06dfa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.513490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa87acc-a408-43e8-988d-29823e06dfa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6aa87acc-a408-43e8-988d-29823e06dfa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:04.518306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:04.519199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:04.520077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 413/850] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:04.520773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa87acc-a408-43e8-988d-29823e06dfa2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.543315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146cfc0-9575-4763-802b-b1d4051e58ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.543951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146cfc0-9575-4763-802b-b1d4051e58ff None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.544231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146cfc0-9575-4763-802b-b1d4051e58ff None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.544506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146cfc0-9575-4763-802b-b1d4051e58ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.551584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146cfc0-9575-4763-802b-b1d4051e58ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.553045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146cfc0-9575-4763-802b-b1d4051e58ff None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5146cfc0-9575-4763-802b-b1d4051e58ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:04.564105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:04.564998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 438/851] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:04.565898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146cfc0-9575-4763-802b-b1d4051e58ff None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.581296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:04.624433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa87acc-a408-43e8-988d-29823e06dfa2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.657786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f08509-d685-44f2-b58c-9074021c4c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.658531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f08509-d685-44f2-b58c-9074021c4c53 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.658879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f08509-d685-44f2-b58c-9074021c4c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.659186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f08509-d685-44f2-b58c-9074021c4c53 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.659849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f08509-d685-44f2-b58c-9074021c4c53 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:04.660155 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f08509-d685-44f2-b58c-9074021c4c53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.661517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f08509-d685-44f2-b58c-9074021c4c53 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.661934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146cfc0-9575-4763-802b-b1d4051e58ff None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.665970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 414/852] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:04.667124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17167e-0c59-405f-bdf2-2f48651e6538 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.667411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17167e-0c59-405f-bdf2-2f48651e6538 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.667684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17167e-0c59-405f-bdf2-2f48651e6538 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.669053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 415/853] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:04.670906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17167e-0c59-405f-bdf2-2f48651e6538 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.703904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd03729-a1d3-4d70-ab4d-ed8cbb9444e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.704525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd03729-a1d3-4d70-ab4d-ed8cbb9444e5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.704825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd03729-a1d3-4d70-ab4d-ed8cbb9444e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.705076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd03729-a1d3-4d70-ab4d-ed8cbb9444e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.706038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd03729-a1d3-4d70-ab4d-ed8cbb9444e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:04.706038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd03729-a1d3-4d70-ab4d-ed8cbb9444e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.707505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd03729-a1d3-4d70-ab4d-ed8cbb9444e5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.716952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 439/854] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:04.718060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b6012-559b-4526-9a42-106df3e7e0f4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.718398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b6012-559b-4526-9a42-106df3e7e0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.719075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b6012-559b-4526-9a42-106df3e7e0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.739189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2b8b6012-559b-4526-9a42-106df3e7e0f4 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:04.740419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b8b6012-559b-4526-9a42-106df3e7e0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:04.742753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:04.786453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17167e-0c59-405f-bdf2-2f48651e6538 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.807748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:04.816557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 440/855] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:04.817266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b6012-559b-4526-9a42-106df3e7e0f4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.835597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43398e7-9e30-406e-945f-875c990cdb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.836890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43398e7-9e30-406e-945f-875c990cdb41 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.837382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43398e7-9e30-406e-945f-875c990cdb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.838141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43398e7-9e30-406e-945f-875c990cdb41 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.839470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43398e7-9e30-406e-945f-875c990cdb41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:04.839994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43398e7-9e30-406e-945f-875c990cdb41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.841648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43398e7-9e30-406e-945f-875c990cdb41 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.860077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 416/856] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:04.864863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43398e7-9e30-406e-945f-875c990cdb41 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:04.946160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b6012-559b-4526-9a42-106df3e7e0f4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:04.980982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbab79-b8ba-42ec-97b8-b785d15cf99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:04.981674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbab79-b8ba-42ec-97b8-b785d15cf99a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:04.981962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbab79-b8ba-42ec-97b8-b785d15cf99a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:04.982270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbab79-b8ba-42ec-97b8-b785d15cf99a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:04.988981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:04.993115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbab79-b8ba-42ec-97b8-b785d15cf99a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:04.994863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbab79-b8ba-42ec-97b8-b785d15cf99a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:04.998798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43398e7-9e30-406e-945f-875c990cdb41 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-affbab79-b8ba-42ec-97b8-b785d15cf99a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:05.010024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:05.011034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:05.011940 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:05.011940 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:05.011940 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:05.014002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 441/857] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:05.022129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbab79-b8ba-42ec-97b8-b785d15cf99a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:05.041694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6c663-001a-43ab-9173-fd72c3a8efaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:05.042602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6c663-001a-43ab-9173-fd72c3a8efaa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.043079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6c663-001a-43ab-9173-fd72c3a8efaa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.044013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6c663-001a-43ab-9173-fd72c3a8efaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.045240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6c663-001a-43ab-9173-fd72c3a8efaa None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=88353e858ec64a9cbdcfd16dbc00ebe3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:05.045738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6c663-001a-43ab-9173-fd72c3a8efaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:05.048089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6c663-001a-43ab-9173-fd72c3a8efaa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:05.057115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 417/858] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:04 2022] GET /identity/v3/role_assignments?user.id=88353e858ec64a9cbdcfd16dbc00ebe3&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:05.086600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6c663-001a-43ab-9173-fd72c3a8efaa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:05.132520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbab79-b8ba-42ec-97b8-b785d15cf99a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:05.142428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:05.172102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3431c6c-ae61-4fa9-8250-8ab511bca5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:05.172752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3431c6c-ae61-4fa9-8250-8ab511bca5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.173071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3431c6c-ae61-4fa9-8250-8ab511bca5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.173347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3431c6c-ae61-4fa9-8250-8ab511bca5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.174003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3431c6c-ae61-4fa9-8250-8ab511bca5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:05.174358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3431c6c-ae61-4fa9-8250-8ab511bca5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:05.175752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3431c6c-ae61-4fa9-8250-8ab511bca5a2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:05.198547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 442/859] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:05.200236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3431c6c-ae61-4fa9-8250-8ab511bca5a2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:05.215622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6c663-001a-43ab-9173-fd72c3a8efaa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:05.258750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:05.266180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b56b09-ba46-4fef-a20a-7cf9bf5ed382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:05.266836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b56b09-ba46-4fef-a20a-7cf9bf5ed382 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.267275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b56b09-ba46-4fef-a20a-7cf9bf5ed382 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.267545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b56b09-ba46-4fef-a20a-7cf9bf5ed382 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.268149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b56b09-ba46-4fef-a20a-7cf9bf5ed382 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:05.270291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b56b09-ba46-4fef-a20a-7cf9bf5ed382 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c2b56b09-ba46-4fef-a20a-7cf9bf5ed382 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:05.281639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:05.282723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:05.283596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 418/860] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Oct 4 08:44:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:05.289567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b56b09-ba46-4fef-a20a-7cf9bf5ed382 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:05.329525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3431c6c-ae61-4fa9-8250-8ab511bca5a2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:05.368263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa9e78-73ab-4f46-a4d4-8e9b1009d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:05.369056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9e78-73ab-4f46-a4d4-8e9b1009d7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.369422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9e78-73ab-4f46-a4d4-8e9b1009d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.369792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9e78-73ab-4f46-a4d4-8e9b1009d7d4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.378996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa9e78-73ab-4f46-a4d4-8e9b1009d7d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:05.381519 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa9e78-73ab-4f46-a4d4-8e9b1009d7d4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-75fa9e78-73ab-4f46-a4d4-8e9b1009d7d4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:44:05.396830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:05.398710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:44:05.399674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:05.400464 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 443/861] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:44:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:05.405649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa9e78-73ab-4f46-a4d4-8e9b1009d7d4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:05.421326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b56b09-ba46-4fef-a20a-7cf9bf5ed382 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:05.432073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:05.469036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a46b0-6e13-420b-a3f2-2c870a438bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:05.469653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a46b0-6e13-420b-a3f2-2c870a438bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.470199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a46b0-6e13-420b-a3f2-2c870a438bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.470477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a46b0-6e13-420b-a3f2-2c870a438bb4 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.471114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a46b0-6e13-420b-a3f2-2c870a438bb4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:05.471417 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a46b0-6e13-420b-a3f2-2c870a438bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:05.473799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a46b0-6e13-420b-a3f2-2c870a438bb4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:05.480385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 419/862] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:05.485410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a46b0-6e13-420b-a3f2-2c870a438bb4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:05.523730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa9e78-73ab-4f46-a4d4-8e9b1009d7d4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:05.535708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:05.560698 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfa1dd-a6ce-4599-9bd1-00794d479070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:05.561742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfa1dd-a6ce-4599-9bd1-00794d479070 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.562245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfa1dd-a6ce-4599-9bd1-00794d479070 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.562714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfa1dd-a6ce-4599-9bd1-00794d479070 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.563698 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfa1dd-a6ce-4599-9bd1-00794d479070 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:05.564342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfa1dd-a6ce-4599-9bd1-00794d479070 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:05.566063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfa1dd-a6ce-4599-9bd1-00794d479070 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:05.591146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 444/863] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 08:44:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:05.593178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfa1dd-a6ce-4599-9bd1-00794d479070 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:05.603640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a46b0-6e13-420b-a3f2-2c870a438bb4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:05.647787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944df9a-1067-4117-bced-4ca04c37e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:05.649085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944df9a-1067-4117-bced-4ca04c37e3fb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.649378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944df9a-1067-4117-bced-4ca04c37e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.649655 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944df9a-1067-4117-bced-4ca04c37e3fb None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.650423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944df9a-1067-4117-bced-4ca04c37e3fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:05.650737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944df9a-1067-4117-bced-4ca04c37e3fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:05.652249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944df9a-1067-4117-bced-4ca04c37e3fb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:05.663288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 420/864] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:05.716667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfa1dd-a6ce-4599-9bd1-00794d479070 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:05.756466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0c63-718d-404b-9412-ce4cf8984cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:05.757138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0c63-718d-404b-9412-ce4cf8984cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.757469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0c63-718d-404b-9412-ce4cf8984cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.757749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed0c63-718d-404b-9412-ce4cf8984cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.797880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:05.834791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed0c63-718d-404b-9412-ce4cf8984cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:05.837374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed0c63-718d-404b-9412-ce4cf8984cc1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:05.941402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 445/865] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:05.949746 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944df9a-1067-4117-bced-4ca04c37e3fb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:05.985619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:06.061790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944df9a-1067-4117-bced-4ca04c37e3fb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:06.096706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7a364-4054-4591-a9bf-f9143ffd0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:06.097330 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7a364-4054-4591-a9bf-f9143ffd0026 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:06.097609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7a364-4054-4591-a9bf-f9143ffd0026 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:06.097879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7a364-4054-4591-a9bf-f9143ffd0026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:06.108655 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7a364-4054-4591-a9bf-f9143ffd0026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:06.110101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7a364-4054-4591-a9bf-f9143ffd0026 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a6b7a364-4054-4591-a9bf-f9143ffd0026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:06.124961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:06.125865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:06.126798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:06.126798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:06.126798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:06.126798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 421/866] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:06.132991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0c63-718d-404b-9412-ce4cf8984cc1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:06.199981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:06.233490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed0c63-718d-404b-9412-ce4cf8984cc1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:06.268477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadcb7-b889-4ea6-aec6-f65682d371ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:06.269085 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadcb7-b889-4ea6-aec6-f65682d371ee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:06.269366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadcb7-b889-4ea6-aec6-f65682d371ee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:06.269824 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadcb7-b889-4ea6-aec6-f65682d371ee None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:06.270652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbadcb7-b889-4ea6-aec6-f65682d371ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:06.270966 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbadcb7-b889-4ea6-aec6-f65682d371ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:06.272334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbadcb7-b889-4ea6-aec6-f65682d371ee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:06.284663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 446/867] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:06.290760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7a364-4054-4591-a9bf-f9143ffd0026 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:06.376901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:06.391928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7a364-4054-4591-a9bf-f9143ffd0026 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:06.427378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3daa-1017-4555-b0ee-a796452915c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:06.428058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3daa-1017-4555-b0ee-a796452915c0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:06.428340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3daa-1017-4555-b0ee-a796452915c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:06.428606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c3daa-1017-4555-b0ee-a796452915c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:06.436117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c3daa-1017-4555-b0ee-a796452915c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:06.437557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c3daa-1017-4555-b0ee-a796452915c0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c77c3daa-1017-4555-b0ee-a796452915c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:06.449821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:06.450810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:06.451713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:06.451713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:06.451713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:06.451713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:06.451713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:06.451713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:06.451713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:06.451713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:06.451713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 422/868] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:06.457237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadcb7-b889-4ea6-aec6-f65682d371ee None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:06.562835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadcb7-b889-4ea6-aec6-f65682d371ee None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:06.590767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:06.598643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b68c0-002f-4195-9307-3628cc619f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:06.599372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b68c0-002f-4195-9307-3628cc619f92 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:06.599653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b68c0-002f-4195-9307-3628cc619f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:06.599984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b68c0-002f-4195-9307-3628cc619f92 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:06.600701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b68c0-002f-4195-9307-3628cc619f92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:06.601041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b68c0-002f-4195-9307-3628cc619f92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:06.602631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b68c0-002f-4195-9307-3628cc619f92 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:06.616892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 447/869] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:06.623493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3daa-1017-4555-b0ee-a796452915c0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:06.726891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c3daa-1017-4555-b0ee-a796452915c0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:06.760888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942b569-dea4-40fb-b652-b45b66483920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:06.761717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942b569-dea4-40fb-b652-b45b66483920 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:06.762008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942b569-dea4-40fb-b652-b45b66483920 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:06.762319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942b569-dea4-40fb-b652-b45b66483920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:06.763056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942b569-dea4-40fb-b652-b45b66483920 None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=afdc2662bd3148e3b120427adcc1a12b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:06.763366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942b569-dea4-40fb-b652-b45b66483920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:06.764795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942b569-dea4-40fb-b652-b45b66483920 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:06.770955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 423/870] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:06 2022] GET /identity/v3/role_assignments?user.id=afdc2662bd3148e3b120427adcc1a12b&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:07.036063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fe5de-fd24-4ce6-bb55-391ed8353a65 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:07.036356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fe5de-fd24-4ce6-bb55-391ed8353a65 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:07.036551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fe5de-fd24-4ce6-bb55-391ed8353a65 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:07.038785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 448/871] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:07.044377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9917ca-023a-4227-8ac8-0122ca6e242d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:07.044821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9917ca-023a-4227-8ac8-0122ca6e242d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:07.045007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9917ca-023a-4227-8ac8-0122ca6e242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:07.064638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0a9917ca-023a-4227-8ac8-0122ca6e242d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:07.066224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0a9917ca-023a-4227-8ac8-0122ca6e242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:07.069413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:07.134509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 424/872] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:07.355547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6179de6-4ec0-4eb6-89d8-7249d47fa5e2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:07.356052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6179de6-4ec0-4eb6-89d8-7249d47fa5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:07.356143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6179de6-4ec0-4eb6-89d8-7249d47fa5e2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:07.357661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 449/873] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:07.362995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30085b-e8a7-41e5-9028-3da6bc367d38 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:07.363286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30085b-e8a7-41e5-9028-3da6bc367d38 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:07.363561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30085b-e8a7-41e5-9028-3da6bc367d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:07.381870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2c30085b-e8a7-41e5-9028-3da6bc367d38 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:07.383734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2c30085b-e8a7-41e5-9028-3da6bc367d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:07.405495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6179de6-4ec0-4eb6-89d8-7249d47fa5e2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:07.455993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 425/874] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:07.518300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6179de6-4ec0-4eb6-89d8-7249d47fa5e2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:07.553662 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cd1f4-903f-489b-b342-3dba7d226047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:07.554843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cd1f4-903f-489b-b342-3dba7d226047 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:07.555124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cd1f4-903f-489b-b342-3dba7d226047 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:07.555394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cd1f4-903f-489b-b342-3dba7d226047 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:07.556067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cd1f4-903f-489b-b342-3dba7d226047 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:07.557433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cd1f4-903f-489b-b342-3dba7d226047 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:07.629981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 450/875] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:44:07 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:07.724697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30085b-e8a7-41e5-9028-3da6bc367d38 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:07.803330 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:07.840024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30085b-e8a7-41e5-9028-3da6bc367d38 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:07.884383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266905a-3952-43b5-9841-12b255a5d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:07.884946 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266905a-3952-43b5-9841-12b255a5d77b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:07.885223 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266905a-3952-43b5-9841-12b255a5d77b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:07.885491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266905a-3952-43b5-9841-12b255a5d77b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:07.886075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266905a-3952-43b5-9841-12b255a5d77b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:07.887454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266905a-3952-43b5-9841-12b255a5d77b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3266905a-3952-43b5-9841-12b255a5d77b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:07.896309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:07.897269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:07.898719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 426/876] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:07.903380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cd1f4-903f-489b-b342-3dba7d226047 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:07.951311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400586b-680d-43da-9df4-3b7e780dd310 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:07.951598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400586b-680d-43da-9df4-3b7e780dd310 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:07.951867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400586b-680d-43da-9df4-3b7e780dd310 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:07.953350 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 427/877] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:07.958309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63977c-257d-4e75-b445-8e83a79c4af7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:07.958592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63977c-257d-4e75-b445-8e83a79c4af7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:07.958864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63977c-257d-4e75-b445-8e83a79c4af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:07.975063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:07.980559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2b63977c-257d-4e75-b445-8e83a79c4af7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:07.981916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2b63977c-257d-4e75-b445-8e83a79c4af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:08.030882 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cd1f4-903f-489b-b342-3dba7d226047 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:08.064792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 428/878] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:08.075861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4a253-523a-4224-b3f0-cc1260e1546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:08.076680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4a253-523a-4224-b3f0-cc1260e1546e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:08.077105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4a253-523a-4224-b3f0-cc1260e1546e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:08.077545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4a253-523a-4224-b3f0-cc1260e1546e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:08.078350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4a253-523a-4224-b3f0-cc1260e1546e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:08.078813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4a253-523a-4224-b3f0-cc1260e1546e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:08.080326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4a253-523a-4224-b3f0-cc1260e1546e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:08.086344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 451/879] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:08.092089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63977c-257d-4e75-b445-8e83a79c4af7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:08.152724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:08.194289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63977c-257d-4e75-b445-8e83a79c4af7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:08.227808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20854d5e-1e62-430c-b802-4804a2656089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:08.228665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854d5e-1e62-430c-b802-4804a2656089 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:08.228940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854d5e-1e62-430c-b802-4804a2656089 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:08.229213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20854d5e-1e62-430c-b802-4804a2656089 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:08.229839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20854d5e-1e62-430c-b802-4804a2656089 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:08.230158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20854d5e-1e62-430c-b802-4804a2656089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:08.231515 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20854d5e-1e62-430c-b802-4804a2656089 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:08.236131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 429/880] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:08.374108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4a253-523a-4224-b3f0-cc1260e1546e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:08.483857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4a253-523a-4224-b3f0-cc1260e1546e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:08.498074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:08.520423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a9a2-7f1d-4f72-a6c3-22d7d28751e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:08.525273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a9a2-7f1d-4f72-a6c3-22d7d28751e6 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:08.525273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a9a2-7f1d-4f72-a6c3-22d7d28751e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:08.525273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a9a2-7f1d-4f72-a6c3-22d7d28751e6 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:08.525273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a9a2-7f1d-4f72-a6c3-22d7d28751e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:08.525273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a9a2-7f1d-4f72-a6c3-22d7d28751e6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:08.669971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 452/881] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:44:08 2022] POST /identity/v3/services => generated 269 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:09.088499 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9447d-71e5-471f-b771-a72969349275 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:09.089006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9447d-71e5-471f-b771-a72969349275 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:09.089083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9447d-71e5-471f-b771-a72969349275 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:09.090650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 430/882] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:09.099637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4b7bd-d81a-49af-b129-a5c3f0727403 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:09.100033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4b7bd-d81a-49af-b129-a5c3f0727403 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:09.100403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4b7bd-d81a-49af-b129-a5c3f0727403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:09.120088 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-09a4b7bd-d81a-49af-b129-a5c3f0727403 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:09.121264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-09a4b7bd-d81a-49af-b129-a5c3f0727403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:09.199291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 453/883] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:09.464866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9447d-71e5-471f-b771-a72969349275 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:09.566993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9447d-71e5-471f-b771-a72969349275 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:09.593036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:09.604011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50817ae6-875c-43e2-b9a6-8be66ad7ecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:09.604645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50817ae6-875c-43e2-b9a6-8be66ad7ecbd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:09.604927 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50817ae6-875c-43e2-b9a6-8be66ad7ecbd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:09.605201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50817ae6-875c-43e2-b9a6-8be66ad7ecbd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:09.615503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50817ae6-875c-43e2-b9a6-8be66ad7ecbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-50817ae6-875c-43e2-b9a6-8be66ad7ecbd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:09.620951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:09.622108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:09.623323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 431/884] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 08:44:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:09.628157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4b7bd-d81a-49af-b129-a5c3f0727403 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:09.740654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:09.745363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4b7bd-d81a-49af-b129-a5c3f0727403 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:09.779359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a659be3-c1ce-469c-a7cb-ffe472b3cd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:09.779968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a659be3-c1ce-469c-a7cb-ffe472b3cd54 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:09.780247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a659be3-c1ce-469c-a7cb-ffe472b3cd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:09.780517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a659be3-c1ce-469c-a7cb-ffe472b3cd54 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:09.781202 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a659be3-c1ce-469c-a7cb-ffe472b3cd54 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:09.781575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a659be3-c1ce-469c-a7cb-ffe472b3cd54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:09.782997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a659be3-c1ce-469c-a7cb-ffe472b3cd54 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:09.791470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 454/885] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 08:44:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:09.796807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50817ae6-875c-43e2-b9a6-8be66ad7ecbd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:09.906892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50817ae6-875c-43e2-b9a6-8be66ad7ecbd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:09.936685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ada7f-1eec-498c-915e-3a228fceba45 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:09.936685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ada7f-1eec-498c-915e-3a228fceba45 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:09.936685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ada7f-1eec-498c-915e-3a228fceba45 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:09.936685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 455/886] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:09.942676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310d0e9-9481-46cc-b4dd-15eb9f0e398a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:09.942676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310d0e9-9481-46cc-b4dd-15eb9f0e398a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:09.942676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310d0e9-9481-46cc-b4dd-15eb9f0e398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:09.954779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674666c-529d-41c6-9d3d-2e445906c633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:09.955421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674666c-529d-41c6-9d3d-2e445906c633 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:09.955706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674666c-529d-41c6-9d3d-2e445906c633 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:09.955983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674666c-529d-41c6-9d3d-2e445906c633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:09.967024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4310d0e9-9481-46cc-b4dd-15eb9f0e398a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:09.967816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674666c-529d-41c6-9d3d-2e445906c633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:09.968725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4310d0e9-9481-46cc-b4dd-15eb9f0e398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:09.969273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674666c-529d-41c6-9d3d-2e445906c633 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c674666c-529d-41c6-9d3d-2e445906c633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:09.985589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:09.986661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:09.987608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:09.987608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:09.987608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:09.989891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 432/887] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:10.001170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674666c-529d-41c6-9d3d-2e445906c633 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:10.041450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:10.054496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 456/888] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:10.118816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674666c-529d-41c6-9d3d-2e445906c633 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:10.153304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2388726-11fb-4110-8002-9f7681ababab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:10.153957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2388726-11fb-4110-8002-9f7681ababab None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.154265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2388726-11fb-4110-8002-9f7681ababab None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.154584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2388726-11fb-4110-8002-9f7681ababab None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.155233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2388726-11fb-4110-8002-9f7681ababab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:10.155537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2388726-11fb-4110-8002-9f7681ababab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:10.156907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2388726-11fb-4110-8002-9f7681ababab None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:10.169040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 433/889] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:10.174653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310d0e9-9481-46cc-b4dd-15eb9f0e398a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:10.272129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:10.281704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310d0e9-9481-46cc-b4dd-15eb9f0e398a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:10.316290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac4927-cd3c-47bd-bc56-9c928abda630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:10.316929 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac4927-cd3c-47bd-bc56-9c928abda630 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.317268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac4927-cd3c-47bd-bc56-9c928abda630 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.317552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac4927-cd3c-47bd-bc56-9c928abda630 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.325386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac4927-cd3c-47bd-bc56-9c928abda630 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:10.326867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac4927-cd3c-47bd-bc56-9c928abda630 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b7ac4927-cd3c-47bd-bc56-9c928abda630 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:44:10.338630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:10.339587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:10.340842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 457/890] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:44:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:10.345672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2388726-11fb-4110-8002-9f7681ababab None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:10.355722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac4927-cd3c-47bd-bc56-9c928abda630 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:10.462827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:10.469766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2388726-11fb-4110-8002-9f7681ababab None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:10.471548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac4927-cd3c-47bd-bc56-9c928abda630 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:10.505205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d236745-b645-4284-8d70-31e3f1e0e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:10.505816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d236745-b645-4284-8d70-31e3f1e0e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.506129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d236745-b645-4284-8d70-31e3f1e0e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.506396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d236745-b645-4284-8d70-31e3f1e0e9f9 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.507728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d236745-b645-4284-8d70-31e3f1e0e9f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:10.508037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d236745-b645-4284-8d70-31e3f1e0e9f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:10.508359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b75ca6-f1fc-4f63-b2b7-f9274d165a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:10.508996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b75ca6-f1fc-4f63-b2b7-f9274d165a7f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.509282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b75ca6-f1fc-4f63-b2b7-f9274d165a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.509467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d236745-b645-4284-8d70-31e3f1e0e9f9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:10.509574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b75ca6-f1fc-4f63-b2b7-f9274d165a7f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.510162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b75ca6-f1fc-4f63-b2b7-f9274d165a7f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:10.511537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b75ca6-f1fc-4f63-b2b7-f9274d165a7f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-32b75ca6-f1fc-4f63-b2b7-f9274d165a7f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:10.520635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:10.521682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:10.523022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 458/891] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:44:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:10.527480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5885d-7084-47d9-84d7-913d7039e856 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.527773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5885d-7084-47d9-84d7-913d7039e856 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.528050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5885d-7084-47d9-84d7-913d7039e856 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.529472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 459/892] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:10.532563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 434/893] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 08:44:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:10.533452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d236745-b645-4284-8d70-31e3f1e0e9f9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:10.534106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5885d-7084-47d9-84d7-913d7039e856 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:10.552541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:10.640695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d236745-b645-4284-8d70-31e3f1e0e9f9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:10.644218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5885d-7084-47d9-84d7-913d7039e856 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:10.676145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6d107-b43b-4cfe-bee5-b5d34ba26a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:10.676765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6d107-b43b-4cfe-bee5-b5d34ba26a13 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.677050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6d107-b43b-4cfe-bee5-b5d34ba26a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.677327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6d107-b43b-4cfe-bee5-b5d34ba26a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.680557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5e344-21b2-4fc9-9136-779032194e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:10.681954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e344-21b2-4fc9-9136-779032194e43 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.682291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e344-21b2-4fc9-9136-779032194e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.682572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e344-21b2-4fc9-9136-779032194e43 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.683214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5e344-21b2-4fc9-9136-779032194e43 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:10.683522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5e344-21b2-4fc9-9136-779032194e43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:10.684900 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5e344-21b2-4fc9-9136-779032194e43 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:10.695597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 460/894] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:44:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:10.695597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93210fb6-47b7-4481-8ebd-ce06ea2975a2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.695597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93210fb6-47b7-4481-8ebd-ce06ea2975a2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.695597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93210fb6-47b7-4481-8ebd-ce06ea2975a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.702496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:10.713559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-93210fb6-47b7-4481-8ebd-ce06ea2975a2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:10.714785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-93210fb6-47b7-4481-8ebd-ce06ea2975a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:10.753527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6d107-b43b-4cfe-bee5-b5d34ba26a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:10.755718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6d107-b43b-4cfe-bee5-b5d34ba26a13 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:10.790201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 461/895] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:10.790201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93210fb6-47b7-4481-8ebd-ce06ea2975a2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:10.801206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:10.877250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 435/896] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:10 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:10.878174 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6d107-b43b-4cfe-bee5-b5d34ba26a13 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:10.909226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93210fb6-47b7-4481-8ebd-ce06ea2975a2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:10.946991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:10.948980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c519f0c-93b3-4d15-a801-c061ab2d2a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:10.949854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c519f0c-93b3-4d15-a801-c061ab2d2a14 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.950386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c519f0c-93b3-4d15-a801-c061ab2d2a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.950865 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c519f0c-93b3-4d15-a801-c061ab2d2a14 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.951706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c519f0c-93b3-4d15-a801-c061ab2d2a14 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:10.952213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c519f0c-93b3-4d15-a801-c061ab2d2a14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:10.953812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c519f0c-93b3-4d15-a801-c061ab2d2a14 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:10.959183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 462/897] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:44:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:10.961263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb68bb-e3c3-49c7-91ba-4e3abdfc3640 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.961764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb68bb-e3c3-49c7-91ba-4e3abdfc3640 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.962270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb68bb-e3c3-49c7-91ba-4e3abdfc3640 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.963915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 463/898] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:10.969912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb68bb-e3c3-49c7-91ba-4e3abdfc3640 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:10.996650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6d107-b43b-4cfe-bee5-b5d34ba26a13 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.032863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c9ef9-c677-467b-9c70-75b23448cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.033484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c9ef9-c677-467b-9c70-75b23448cc82 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.033765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c9ef9-c677-467b-9c70-75b23448cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.034035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c9ef9-c677-467b-9c70-75b23448cc82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.042546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:11.045479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c9ef9-c677-467b-9c70-75b23448cc82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.047314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c9ef9-c677-467b-9c70-75b23448cc82 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3f2c9ef9-c677-467b-9c70-75b23448cc82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:11.062247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:11.063194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:11.064156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:11.064156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:11.064156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:11.064156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 436/899] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:11.064993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07660c6-f674-44d4-9150-8da9a684fd60 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.064993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07660c6-f674-44d4-9150-8da9a684fd60 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.065131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07660c6-f674-44d4-9150-8da9a684fd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.080277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb68bb-e3c3-49c7-91ba-4e3abdfc3640 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.083531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d07660c6-f674-44d4-9150-8da9a684fd60 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:11.084725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d07660c6-f674-44d4-9150-8da9a684fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:11.113356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a719d79-234f-44c8-bf32-9831e8d50a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.113974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a719d79-234f-44c8-bf32-9831e8d50a41 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.114286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a719d79-234f-44c8-bf32-9831e8d50a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.114565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a719d79-234f-44c8-bf32-9831e8d50a41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.115258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a719d79-234f-44c8-bf32-9831e8d50a41 None admin] RBAC: Adding query filter params (interface=public, service_id=98ffc19cf59b46f1b763e4676c4c5ff2, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:11.115565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a719d79-234f-44c8-bf32-9831e8d50a41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.117439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a719d79-234f-44c8-bf32-9831e8d50a41 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.124663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 464/900] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 08:44:10 2022] GET /identity/v3/endpoints?service_id=98ffc19cf59b46f1b763e4676c4c5ff2&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:11.125446 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a719d79-234f-44c8-bf32-9831e8d50a41 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:11.150722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 437/901] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:11.151549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07660c6-f674-44d4-9150-8da9a684fd60 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:11.187591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:11.235695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a719d79-234f-44c8-bf32-9831e8d50a41 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.256212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07660c6-f674-44d4-9150-8da9a684fd60 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.270246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66741e49-f8aa-4374-8c2b-eb7b7f87ce5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.270778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66741e49-f8aa-4374-8c2b-eb7b7f87ce5d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.271059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66741e49-f8aa-4374-8c2b-eb7b7f87ce5d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.271331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66741e49-f8aa-4374-8c2b-eb7b7f87ce5d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.271980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66741e49-f8aa-4374-8c2b-eb7b7f87ce5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:11.272288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66741e49-f8aa-4374-8c2b-eb7b7f87ce5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.273946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66741e49-f8aa-4374-8c2b-eb7b7f87ce5d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.276260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:11.287479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 465/902] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:11.288596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66741e49-f8aa-4374-8c2b-eb7b7f87ce5d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:11.298141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fb995-01aa-41dd-9cdb-f5d46b7536af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.298717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fb995-01aa-41dd-9cdb-f5d46b7536af None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.299003 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fb995-01aa-41dd-9cdb-f5d46b7536af None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.299283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fb995-01aa-41dd-9cdb-f5d46b7536af None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.299945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fb995-01aa-41dd-9cdb-f5d46b7536af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.301313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fb995-01aa-41dd-9cdb-f5d46b7536af None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.392678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66741e49-f8aa-4374-8c2b-eb7b7f87ce5d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.400156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 438/903] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:44:11 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:11.400156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fb995-01aa-41dd-9cdb-f5d46b7536af None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:11.448000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e409ee1-14cb-4fd0-8834-b5941e03152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.448638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e409ee1-14cb-4fd0-8834-b5941e03152b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.448954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e409ee1-14cb-4fd0-8834-b5941e03152b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.449351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e409ee1-14cb-4fd0-8834-b5941e03152b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.449994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e409ee1-14cb-4fd0-8834-b5941e03152b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.451651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e409ee1-14cb-4fd0-8834-b5941e03152b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.462306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 466/904] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 08:44:11 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:44:11.463675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e409ee1-14cb-4fd0-8834-b5941e03152b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:11.530452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:11.533068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fb995-01aa-41dd-9cdb-f5d46b7536af None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.552018 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:11.580506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6c625-73aa-4473-a960-d33bdf40db93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.581534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c625-73aa-4473-a960-d33bdf40db93 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.582274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c625-73aa-4473-a960-d33bdf40db93 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.582653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c625-73aa-4473-a960-d33bdf40db93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.592838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6c625-73aa-4473-a960-d33bdf40db93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.594382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6c625-73aa-4473-a960-d33bdf40db93 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-73e6c625-73aa-4473-a960-d33bdf40db93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:11.608145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:11.609539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:11.610456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:11.610456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:11.610456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:11.610456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:11.610456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:11.610456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:11.610456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:11.610456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:11.610456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 439/905] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:11.616908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6c625-73aa-4473-a960-d33bdf40db93 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:11.617124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e409ee1-14cb-4fd0-8834-b5941e03152b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.659177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950edd04-3efe-446a-8045-4c13844ff362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.659798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950edd04-3efe-446a-8045-4c13844ff362 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.660217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950edd04-3efe-446a-8045-4c13844ff362 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.660519 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950edd04-3efe-446a-8045-4c13844ff362 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.661229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950edd04-3efe-446a-8045-4c13844ff362 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.662801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950edd04-3efe-446a-8045-4c13844ff362 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-950edd04-3efe-446a-8045-4c13844ff362 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:11.675355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:11.676346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:11.677218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 467/906] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Oct 4 08:44:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:11.683451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950edd04-3efe-446a-8045-4c13844ff362 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:11.747067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6c625-73aa-4473-a960-d33bdf40db93 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.786413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7583d2-59c9-4dab-b41b-10f23ab8445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.787131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7583d2-59c9-4dab-b41b-10f23ab8445a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.787414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7583d2-59c9-4dab-b41b-10f23ab8445a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.787689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7583d2-59c9-4dab-b41b-10f23ab8445a None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.788415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7583d2-59c9-4dab-b41b-10f23ab8445a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:11.788881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7583d2-59c9-4dab-b41b-10f23ab8445a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.790770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7583d2-59c9-4dab-b41b-10f23ab8445a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.813327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 440/907] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:11.813327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7583d2-59c9-4dab-b41b-10f23ab8445a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:11.814658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950edd04-3efe-446a-8045-4c13844ff362 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.831480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:11.845338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:11.864776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957340e0-560d-44d2-a5c8-3f221712f08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.866013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957340e0-560d-44d2-a5c8-3f221712f08c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.872188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957340e0-560d-44d2-a5c8-3f221712f08c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.872188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957340e0-560d-44d2-a5c8-3f221712f08c None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.872188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957340e0-560d-44d2-a5c8-3f221712f08c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:11.872188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957340e0-560d-44d2-a5c8-3f221712f08c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.872188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957340e0-560d-44d2-a5c8-3f221712f08c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.878912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 468/908] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:11.884039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957340e0-560d-44d2-a5c8-3f221712f08c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:11.922389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7583d2-59c9-4dab-b41b-10f23ab8445a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:11.974844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620836cd-fb9d-4cfe-a5b2-715572a82420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:11.976501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620836cd-fb9d-4cfe-a5b2-715572a82420 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.976946 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620836cd-fb9d-4cfe-a5b2-715572a82420 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.977947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620836cd-fb9d-4cfe-a5b2-715572a82420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.979400 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620836cd-fb9d-4cfe-a5b2-715572a82420 None admin] RBAC: Adding query filter params (role.id=a3ff1ddfe66c4d2eba431a612b81a285, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=afdc2662bd3148e3b120427adcc1a12b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:11.979858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620836cd-fb9d-4cfe-a5b2-715572a82420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:11.981899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620836cd-fb9d-4cfe-a5b2-715572a82420 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:11.994565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 441/909] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:11 2022] GET /identity/v3/role_assignments?user.id=afdc2662bd3148e3b120427adcc1a12b&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a3ff1ddfe66c4d2eba431a612b81a285 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:12.020210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957340e0-560d-44d2-a5c8-3f221712f08c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:12.059373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80635-6626-4887-a16a-c5f9c180e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:12.060010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80635-6626-4887-a16a-c5f9c180e80f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:12.060293 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80635-6626-4887-a16a-c5f9c180e80f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:12.060569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80635-6626-4887-a16a-c5f9c180e80f None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:12.061224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc80635-6626-4887-a16a-c5f9c180e80f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:12.061528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc80635-6626-4887-a16a-c5f9c180e80f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:12.062966 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc80635-6626-4887-a16a-c5f9c180e80f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:12.069188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 469/910] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:12.075234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620836cd-fb9d-4cfe-a5b2-715572a82420 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:12.173416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:12.193529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620836cd-fb9d-4cfe-a5b2-715572a82420 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:12.230072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d32746-f9a3-42e0-9422-7e3cfc93024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:12.230716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d32746-f9a3-42e0-9422-7e3cfc93024a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:12.231000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d32746-f9a3-42e0-9422-7e3cfc93024a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:12.231274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d32746-f9a3-42e0-9422-7e3cfc93024a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:12.231989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d32746-f9a3-42e0-9422-7e3cfc93024a None admin] RBAC: Adding query filter params (interface=public, service_id=fad6d90ff441431e958062d3dec906b7, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:12.232298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d32746-f9a3-42e0-9422-7e3cfc93024a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:12.233672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d32746-f9a3-42e0-9422-7e3cfc93024a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:12.239520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 442/911] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 08:44:12 2022] GET /identity/v3/endpoints?service_id=fad6d90ff441431e958062d3dec906b7&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:12.245086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80635-6626-4887-a16a-c5f9c180e80f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:12.298742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:12.351446 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80635-6626-4887-a16a-c5f9c180e80f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:12.388628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473bc58-cd1c-458f-a27d-f4f20dd89b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:12.389259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473bc58-cd1c-458f-a27d-f4f20dd89b8d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:12.389609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473bc58-cd1c-458f-a27d-f4f20dd89b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:12.389885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473bc58-cd1c-458f-a27d-f4f20dd89b8d None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:12.390537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473bc58-cd1c-458f-a27d-f4f20dd89b8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:12.391930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473bc58-cd1c-458f-a27d-f4f20dd89b8d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:12.399671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 470/912] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 08:44:12 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:44:13.658933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5342e0-21e5-42de-b2bc-04d14aec8c54 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:13.659487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5342e0-21e5-42de-b2bc-04d14aec8c54 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:13.659487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5342e0-21e5-42de-b2bc-04d14aec8c54 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:13.661058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 443/913] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:13.666962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f865a-e746-4045-a469-6cf29cb4f648 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:13.667392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f865a-e746-4045-a469-6cf29cb4f648 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:13.667591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f865a-e746-4045-a469-6cf29cb4f648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:13.686437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4f3f865a-e746-4045-a469-6cf29cb4f648 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:13.687633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4f3f865a-e746-4045-a469-6cf29cb4f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:13.698867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18408118-1029-4f16-8237-35f7dca8c55e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:13.699168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18408118-1029-4f16-8237-35f7dca8c55e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:13.699408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18408118-1029-4f16-8237-35f7dca8c55e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:13.701070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 444/914] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:13.707535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08def8c6-5c18-45d6-b87f-ca850e4a7f64 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:13.707934 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08def8c6-5c18-45d6-b87f-ca850e4a7f64 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:13.708310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08def8c6-5c18-45d6-b87f-ca850e4a7f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:13.729914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-08def8c6-5c18-45d6-b87f-ca850e4a7f64 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:13.731276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-08def8c6-5c18-45d6-b87f-ca850e4a7f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:13.769630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 471/915] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:13.810984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 445/916] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:14.046341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f865a-e746-4045-a469-6cf29cb4f648 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.087859 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08def8c6-5c18-45d6-b87f-ca850e4a7f64 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.092650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:14.169147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f865a-e746-4045-a469-6cf29cb4f648 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:14.184083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:14.212596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08def8c6-5c18-45d6-b87f-ca850e4a7f64 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:14.214494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152497f2-657e-4e8e-819b-84c2906d4e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:14.217053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152497f2-657e-4e8e-819b-84c2906d4e8b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.217535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152497f2-657e-4e8e-819b-84c2906d4e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.217990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152497f2-657e-4e8e-819b-84c2906d4e8b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.218787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152497f2-657e-4e8e-819b-84c2906d4e8b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:14.220502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152497f2-657e-4e8e-819b-84c2906d4e8b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-152497f2-657e-4e8e-819b-84c2906d4e8b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:14.232350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:14.233345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:14.234884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 472/917] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:14.235697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1a219-e389-4fb3-afbd-34f5e6788e2c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.235697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1a219-e389-4fb3-afbd-34f5e6788e2c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.235697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1a219-e389-4fb3-afbd-34f5e6788e2c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.238132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 473/918] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:14.239199 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1a219-e389-4fb3-afbd-34f5e6788e2c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.257359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d615181-99c3-40b7-9794-6245eff2acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:14.257998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d615181-99c3-40b7-9794-6245eff2acf2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.258356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d615181-99c3-40b7-9794-6245eff2acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.258615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d615181-99c3-40b7-9794-6245eff2acf2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.259208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d615181-99c3-40b7-9794-6245eff2acf2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:14.260569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d615181-99c3-40b7-9794-6245eff2acf2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2d615181-99c3-40b7-9794-6245eff2acf2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:14.270023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:14.271189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:14.272178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 446/919] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:14.273508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b547942-3d88-41ac-8927-e47052b079d6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.273508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b547942-3d88-41ac-8927-e47052b079d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.273638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b547942-3d88-41ac-8927-e47052b079d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.292322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7b547942-3d88-41ac-8927-e47052b079d6 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:14.293511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7b547942-3d88-41ac-8927-e47052b079d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:14.352590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1a219-e389-4fb3-afbd-34f5e6788e2c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:14.361321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:14.366114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 447/920] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:14.366114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b547942-3d88-41ac-8927-e47052b079d6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.409626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e3617-55b9-4b96-8f03-114190c06d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:14.410393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e3617-55b9-4b96-8f03-114190c06d2b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.411203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e3617-55b9-4b96-8f03-114190c06d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.411559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e3617-55b9-4b96-8f03-114190c06d2b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.412417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e3617-55b9-4b96-8f03-114190c06d2b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:14.413420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e3617-55b9-4b96-8f03-114190c06d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:14.415163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e3617-55b9-4b96-8f03-114190c06d2b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:14.422642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 474/921] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:14.427936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e3617-55b9-4b96-8f03-114190c06d2b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.435471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:14.483376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b547942-3d88-41ac-8927-e47052b079d6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:14.535324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f060c3-066d-4441-b15d-114d1e68bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:14.536904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f060c3-066d-4441-b15d-114d1e68bf5a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.537383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f060c3-066d-4441-b15d-114d1e68bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.537864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f060c3-066d-4441-b15d-114d1e68bf5a None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.539187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f060c3-066d-4441-b15d-114d1e68bf5a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:14.539405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e3617-55b9-4b96-8f03-114190c06d2b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:14.539875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f060c3-066d-4441-b15d-114d1e68bf5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:14.541710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f060c3-066d-4441-b15d-114d1e68bf5a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:14.551595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 448/922] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:14.553033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f060c3-066d-4441-b15d-114d1e68bf5a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.580240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d8d3-ab21-414d-bf8c-6f5882f86391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:14.580879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d8d3-ab21-414d-bf8c-6f5882f86391 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.581157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d8d3-ab21-414d-bf8c-6f5882f86391 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.581429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d8d3-ab21-414d-bf8c-6f5882f86391 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.582064 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1d8d3-ab21-414d-bf8c-6f5882f86391 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:14.582394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1d8d3-ab21-414d-bf8c-6f5882f86391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:14.583764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1d8d3-ab21-414d-bf8c-6f5882f86391 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:14.593459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 475/923] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:14.595256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d8d3-ab21-414d-bf8c-6f5882f86391 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.631659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:14.664709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f060c3-066d-4441-b15d-114d1e68bf5a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:14.693186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:14.697365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d8d3-ab21-414d-bf8c-6f5882f86391 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:14.697957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0f0e2-d1e6-4c05-98a8-034de118922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:14.698585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0f0e2-d1e6-4c05-98a8-034de118922c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.698864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0f0e2-d1e6-4c05-98a8-034de118922c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.699136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0f0e2-d1e6-4c05-98a8-034de118922c None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.699822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0f0e2-d1e6-4c05-98a8-034de118922c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:14.700114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0f0e2-d1e6-4c05-98a8-034de118922c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:14.701472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0f0e2-d1e6-4c05-98a8-034de118922c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:14.706109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 449/924] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:14.707319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf75e6-0cce-4bda-ac1b-565cd2d6d482 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.707608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf75e6-0cce-4bda-ac1b-565cd2d6d482 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.707879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf75e6-0cce-4bda-ac1b-565cd2d6d482 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.709049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 450/925] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:14.709758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf75e6-0cce-4bda-ac1b-565cd2d6d482 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.736757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801f9cf-303e-490e-92d1-0603a51f024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:14.737291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801f9cf-303e-490e-92d1-0603a51f024d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.737571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801f9cf-303e-490e-92d1-0603a51f024d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.737847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801f9cf-303e-490e-92d1-0603a51f024d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.738581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801f9cf-303e-490e-92d1-0603a51f024d None admin] RBAC: Adding query filter params (interface=public, service_id=05aafa816faa460ab71539601ef06f66, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:14.738891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801f9cf-303e-490e-92d1-0603a51f024d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:14.740264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801f9cf-303e-490e-92d1-0603a51f024d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:14.745747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 476/926] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/endpoints?service_id=05aafa816faa460ab71539601ef06f66&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:14.746527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801f9cf-303e-490e-92d1-0603a51f024d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.816971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf75e6-0cce-4bda-ac1b-565cd2d6d482 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:14.840901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:14.844698 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801f9cf-303e-490e-92d1-0603a51f024d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:14.851747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940107df-c514-4d39-ae36-2d0d75ffb0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:14.852375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940107df-c514-4d39-ae36-2d0d75ffb0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.852660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940107df-c514-4d39-ae36-2d0d75ffb0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.853219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940107df-c514-4d39-ae36-2d0d75ffb0a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.863229 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940107df-c514-4d39-ae36-2d0d75ffb0a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-940107df-c514-4d39-ae36-2d0d75ffb0a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:14.868107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:14.869031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:14.870052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 451/927] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:14.871256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5abee-3f0a-4fe2-9fa9-a49e3f12f6bd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.871256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5abee-3f0a-4fe2-9fa9-a49e3f12f6bd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.871256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5abee-3f0a-4fe2-9fa9-a49e3f12f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.879323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74006c4e-3c1c-4409-94a3-ae1343a62817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:14.880252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74006c4e-3c1c-4409-94a3-ae1343a62817 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:14.880989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74006c4e-3c1c-4409-94a3-ae1343a62817 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:14.881262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74006c4e-3c1c-4409-94a3-ae1343a62817 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:14.881932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74006c4e-3c1c-4409-94a3-ae1343a62817 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:14.883340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74006c4e-3c1c-4409-94a3-ae1343a62817 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:14.888345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9df5abee-3f0a-4fe2-9fa9-a49e3f12f6bd None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:14.889545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9df5abee-3f0a-4fe2-9fa9-a49e3f12f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:14.938367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:14.954097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 452/928] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:14.954912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5abee-3f0a-4fe2-9fa9-a49e3f12f6bd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:14.996092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 477/929] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:44:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:14.996867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74006c4e-3c1c-4409-94a3-ae1343a62817 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:15.085332 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5abee-3f0a-4fe2-9fa9-a49e3f12f6bd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:15.142364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef614e-2f98-417b-b2f0-968d40071c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:15.143293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef614e-2f98-417b-b2f0-968d40071c87 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.143772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef614e-2f98-417b-b2f0-968d40071c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.144232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef614e-2f98-417b-b2f0-968d40071c87 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.145037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef614e-2f98-417b-b2f0-968d40071c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:15.146525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74006c4e-3c1c-4409-94a3-ae1343a62817 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:15.146888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef614e-2f98-417b-b2f0-968d40071c87 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:15.160772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 453/930] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:44:15.192623 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd82263-dd19-428d-bb18-73f21c10538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:15.193262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd82263-dd19-428d-bb18-73f21c10538c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.193546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd82263-dd19-428d-bb18-73f21c10538c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.193821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd82263-dd19-428d-bb18-73f21c10538c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.195105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd82263-dd19-428d-bb18-73f21c10538c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:15.195414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd82263-dd19-428d-bb18-73f21c10538c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:15.196856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd82263-dd19-428d-bb18-73f21c10538c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:15.206696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 478/931] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 08:44:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:15.213127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef614e-2f98-417b-b2f0-968d40071c87 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:15.223563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd82263-dd19-428d-bb18-73f21c10538c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:15.243481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:15.278795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:15.343782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd82263-dd19-428d-bb18-73f21c10538c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:15.365622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef614e-2f98-417b-b2f0-968d40071c87 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:15.393467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3335098-3d7e-4d85-8691-d6f66048a40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:15.394447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3335098-3d7e-4d85-8691-d6f66048a40b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.395155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3335098-3d7e-4d85-8691-d6f66048a40b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.395499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3335098-3d7e-4d85-8691-d6f66048a40b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.396368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3335098-3d7e-4d85-8691-d6f66048a40b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:15.398516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3335098-3d7e-4d85-8691-d6f66048a40b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:15.406612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49180-71f4-4b98-87e6-7dd782228081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:15.407243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49180-71f4-4b98-87e6-7dd782228081 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.407521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49180-71f4-4b98-87e6-7dd782228081 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.407790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49180-71f4-4b98-87e6-7dd782228081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e3335098-3d7e-4d85-8691-d6f66048a40b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:15.409857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:15.410801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:44:15.411690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:15.412421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 479/932] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Oct 4 08:44:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:15.417580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3335098-3d7e-4d85-8691-d6f66048a40b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:15.426765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b49180-71f4-4b98-87e6-7dd782228081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:15.428254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b49180-71f4-4b98-87e6-7dd782228081 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-13b49180-71f4-4b98-87e6-7dd782228081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:15.444900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:15.447196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:15.449322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:15.449322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:15.449322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:15.449322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 454/933] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:15.453321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49180-71f4-4b98-87e6-7dd782228081 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:15.503354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:15.526455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3335098-3d7e-4d85-8691-d6f66048a40b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:15.563852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d79487-d43a-4a05-b244-fd5777681602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:15.564524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d79487-d43a-4a05-b244-fd5777681602 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.564870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d79487-d43a-4a05-b244-fd5777681602 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.565213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d79487-d43a-4a05-b244-fd5777681602 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.565907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d79487-d43a-4a05-b244-fd5777681602 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:15.566320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d79487-d43a-4a05-b244-fd5777681602 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:15.567812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d79487-d43a-4a05-b244-fd5777681602 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:15.573437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 480/934] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:15.579155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d79487-d43a-4a05-b244-fd5777681602 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:15.581299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:15.587333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49180-71f4-4b98-87e6-7dd782228081 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:15.630411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bb113-17fa-4d71-8f26-d897d377a963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:15.631158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bb113-17fa-4d71-8f26-d897d377a963 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.631550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bb113-17fa-4d71-8f26-d897d377a963 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.631936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bb113-17fa-4d71-8f26-d897d377a963 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.633171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bb113-17fa-4d71-8f26-d897d377a963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:15.633544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bb113-17fa-4d71-8f26-d897d377a963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:15.635477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bb113-17fa-4d71-8f26-d897d377a963 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:15.650855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 455/935] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:15.656896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bb113-17fa-4d71-8f26-d897d377a963 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:15.711195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d79487-d43a-4a05-b244-fd5777681602 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:15.748302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8484618-39af-49d6-90f4-3055036b25ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:15.748965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8484618-39af-49d6-90f4-3055036b25ef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.749252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8484618-39af-49d6-90f4-3055036b25ef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.749525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8484618-39af-49d6-90f4-3055036b25ef None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.750194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8484618-39af-49d6-90f4-3055036b25ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:15.750502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8484618-39af-49d6-90f4-3055036b25ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:15.751881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8484618-39af-49d6-90f4-3055036b25ef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:15.761509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 481/936] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:15.762853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8484618-39af-49d6-90f4-3055036b25ef None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:15.766971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:15.786893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bb113-17fa-4d71-8f26-d897d377a963 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:15.828243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accaed0-61d0-4464-89ca-e5b5fda58b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:15.829836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accaed0-61d0-4464-89ca-e5b5fda58b2f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.830624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accaed0-61d0-4464-89ca-e5b5fda58b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.831109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accaed0-61d0-4464-89ca-e5b5fda58b2f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.843032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accaed0-61d0-4464-89ca-e5b5fda58b2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:15.844783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accaed0-61d0-4464-89ca-e5b5fda58b2f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0accaed0-61d0-4464-89ca-e5b5fda58b2f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:44:15.861476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:15.862553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:44:15.863493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:15.869303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 456/937] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:44:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:15.872452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accaed0-61d0-4464-89ca-e5b5fda58b2f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:15.879480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8484618-39af-49d6-90f4-3055036b25ef None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:15.903334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:15.920830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1faf3-9206-4673-84e2-0e2ad176134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:15.921743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1faf3-9206-4673-84e2-0e2ad176134f None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.922268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1faf3-9206-4673-84e2-0e2ad176134f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.922790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1faf3-9206-4673-84e2-0e2ad176134f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.923661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1faf3-9206-4673-84e2-0e2ad176134f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:15.925237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1faf3-9206-4673-84e2-0e2ad176134f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:15.993066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accaed0-61d0-4464-89ca-e5b5fda58b2f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:16.029249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 482/938] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:44:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:44:16.044356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29dfa3-f2c2-4334-9256-3faa183b72d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:16.045409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29dfa3-f2c2-4334-9256-3faa183b72d1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:16.045838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29dfa3-f2c2-4334-9256-3faa183b72d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:16.046303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29dfa3-f2c2-4334-9256-3faa183b72d1 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:16.047319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29dfa3-f2c2-4334-9256-3faa183b72d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:16.047797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29dfa3-f2c2-4334-9256-3faa183b72d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:16.049653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29dfa3-f2c2-4334-9256-3faa183b72d1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:16.072696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 457/939] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 08:44:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:16.078171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1faf3-9206-4673-84e2-0e2ad176134f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:16.150758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:16.200601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1faf3-9206-4673-84e2-0e2ad176134f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:16.237060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f917b8-c612-4478-80d5-98f670f05e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:16.237693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f917b8-c612-4478-80d5-98f670f05e61 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:16.237980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f917b8-c612-4478-80d5-98f670f05e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:16.238283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f917b8-c612-4478-80d5-98f670f05e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:16.251332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f917b8-c612-4478-80d5-98f670f05e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:16.252780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f917b8-c612-4478-80d5-98f670f05e61 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c7f917b8-c612-4478-80d5-98f670f05e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:16.271973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:16.273529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:16.274452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:16.274452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:16.274452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:16.274452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 483/940] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:16.279935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29dfa3-f2c2-4334-9256-3faa183b72d1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:16.352039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:16.381728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29dfa3-f2c2-4334-9256-3faa183b72d1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:16.417825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f80dd-bee9-49c2-8650-1c28fb4da902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:16.418385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f80dd-bee9-49c2-8650-1c28fb4da902 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:16.418668 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f80dd-bee9-49c2-8650-1c28fb4da902 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:16.418943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f80dd-bee9-49c2-8650-1c28fb4da902 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:16.419594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f80dd-bee9-49c2-8650-1c28fb4da902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:16.419903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f80dd-bee9-49c2-8650-1c28fb4da902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:16.421270 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f80dd-bee9-49c2-8650-1c28fb4da902 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:16.433252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 458/941] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:16.438817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f917b8-c612-4478-80d5-98f670f05e61 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:16.549192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f917b8-c612-4478-80d5-98f670f05e61 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:16.562494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:16.590241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78235590-998f-4cb9-ba8b-39d3fcf0aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:16.591289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235590-998f-4cb9-ba8b-39d3fcf0aff6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:16.591849 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235590-998f-4cb9-ba8b-39d3fcf0aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:16.592347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235590-998f-4cb9-ba8b-39d3fcf0aff6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:16.599411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78235590-998f-4cb9-ba8b-39d3fcf0aff6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:16.601636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78235590-998f-4cb9-ba8b-39d3fcf0aff6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-78235590-998f-4cb9-ba8b-39d3fcf0aff6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:16.614406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:16.615272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:16.616214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:16.616214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:16.616214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:16.616214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:16.616214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:16.616214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:16.616214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:16.616214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:16.618675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 484/942] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:16.630148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f80dd-bee9-49c2-8650-1c28fb4da902 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:16.725112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f80dd-bee9-49c2-8650-1c28fb4da902 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:16.755894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:16.762885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63103b-2f9c-48a3-8625-88a50d2c9b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:16.763618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63103b-2f9c-48a3-8625-88a50d2c9b1c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:16.763907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63103b-2f9c-48a3-8625-88a50d2c9b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:16.764176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63103b-2f9c-48a3-8625-88a50d2c9b1c None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:16.764878 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63103b-2f9c-48a3-8625-88a50d2c9b1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:16.765182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63103b-2f9c-48a3-8625-88a50d2c9b1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:16.766660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63103b-2f9c-48a3-8625-88a50d2c9b1c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:16.779466 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 459/943] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:16.787134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78235590-998f-4cb9-ba8b-39d3fcf0aff6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:16.895916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78235590-998f-4cb9-ba8b-39d3fcf0aff6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:16.933794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4387f4-b58b-470a-a4a9-931efeb73454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:16.934500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4387f4-b58b-470a-a4a9-931efeb73454 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:16.934784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4387f4-b58b-470a-a4a9-931efeb73454 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:16.935056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4387f4-b58b-470a-a4a9-931efeb73454 None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/afdc2662bd3148e3b120427adcc1a12b/roles/a3ff1ddfe66c4d2eba431a612b81a285` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:16.937277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4387f4-b58b-470a-a4a9-931efeb73454 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=afdc2662bd3148e3b120427adcc1a12b, role_id=a3ff1ddfe66c4d2eba431a612b81a285)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:16.938764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4387f4-b58b-470a-a4a9-931efeb73454 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:17.027063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 485/944] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:44:16 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/afdc2662bd3148e3b120427adcc1a12b/roles/a3ff1ddfe66c4d2eba431a612b81a285 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:44:17.348093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72da62-b085-4e89-9385-8867e158b809 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:17.348615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72da62-b085-4e89-9385-8867e158b809 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:17.348615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72da62-b085-4e89-9385-8867e158b809 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:17.350884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 460/945] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:17.357016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beec352-fadf-449a-be3b-bd67f7db7017 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:17.357362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beec352-fadf-449a-be3b-bd67f7db7017 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:17.357586 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beec352-fadf-449a-be3b-bd67f7db7017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:17.377501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8beec352-fadf-449a-be3b-bd67f7db7017 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:17.378752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8beec352-fadf-449a-be3b-bd67f7db7017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:17.407307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:17.449143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 486/946] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:17.468887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a34471-17f2-420e-9dbf-0db01aa97581 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:17.469173 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a34471-17f2-420e-9dbf-0db01aa97581 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:17.469465 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a34471-17f2-420e-9dbf-0db01aa97581 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:17.471119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 461/947] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:17.476789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a4ff1-fc5e-4d82-92b7-379790b70b8d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:17.477086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a4ff1-fc5e-4d82-92b7-379790b70b8d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:17.477366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a4ff1-fc5e-4d82-92b7-379790b70b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:17.496457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eb2a4ff1-fc5e-4d82-92b7-379790b70b8d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:17.497638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb2a4ff1-fc5e-4d82-92b7-379790b70b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:17.565806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 487/948] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:17.721435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a34471-17f2-420e-9dbf-0db01aa97581 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:17.829134 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a34471-17f2-420e-9dbf-0db01aa97581 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:17.845021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a4ff1-fc5e-4d82-92b7-379790b70b8d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:17.868715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:17.869675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:17.870130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:17.870549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:17.871374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:17.873144 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:17.876158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WARNING keystone.server.flask.common [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 08:44:17.922957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.sql.core [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:44:17.922957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 08:44:17.922957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [parameters: {'id': '1c132e59d1d14606b6c29253f34b5b90', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 08:44:17.922957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81450) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1c132e59d1d14606b6c29253f34b5b90.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1c132e59d1d14606b6c29253f34b5b90. Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:44:17.944530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result.read() Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 08:44:17.945316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application yield resource Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise self.value Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application session.commit() Oct 04 08:44:17.946794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:44:17.948218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:44:17.949117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application result.read() Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:44:17.949911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [parameters: {'id': '1c132e59d1d14606b6c29253f34b5b90', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:17.957732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:17.958695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1c132e59d1d14606b6c29253f34b5b90. Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 462/949] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Oct 4 08:44:17 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:17.959676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:17.963517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:17.976195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a4ff1-fc5e-4d82-92b7-379790b70b8d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:18.016819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984451b-2756-472f-b602-55d97f1b5760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:18.017800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984451b-2756-472f-b602-55d97f1b5760 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.018321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984451b-2756-472f-b602-55d97f1b5760 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.018771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984451b-2756-472f-b602-55d97f1b5760 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.019633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984451b-2756-472f-b602-55d97f1b5760 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:18.021183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984451b-2756-472f-b602-55d97f1b5760 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d984451b-2756-472f-b602-55d97f1b5760 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:18.030594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:18.031562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:18.032381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:18.035207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 488/950] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:18.040031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:18.041887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984451b-2756-472f-b602-55d97f1b5760 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:18.079006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d67be-007b-4ba6-b944-ece8f54ed3f9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:18.117066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88b503-74c7-4ac5-8aa2-5eb5d98834f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:18.118185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b503-74c7-4ac5-8aa2-5eb5d98834f2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.118730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b503-74c7-4ac5-8aa2-5eb5d98834f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.119212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b503-74c7-4ac5-8aa2-5eb5d98834f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.128467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88b503-74c7-4ac5-8aa2-5eb5d98834f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:18.130434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88b503-74c7-4ac5-8aa2-5eb5d98834f2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-da88b503-74c7-4ac5-8aa2-5eb5d98834f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:18.142131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:18.143068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:18.144020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:18.144020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:18.144020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:18.144020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:18.144020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:18.144020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:18.144020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:18.144020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:18.146401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 463/951] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:18.155138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88b503-74c7-4ac5-8aa2-5eb5d98834f2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:18.168555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984451b-2756-472f-b602-55d97f1b5760 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:18.205670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1492232-3c0a-4178-ad92-6da8d910cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:18.206298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1492232-3c0a-4178-ad92-6da8d910cdac None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.206579 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1492232-3c0a-4178-ad92-6da8d910cdac None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.206851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1492232-3c0a-4178-ad92-6da8d910cdac None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.207493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1492232-3c0a-4178-ad92-6da8d910cdac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:18.207780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1492232-3c0a-4178-ad92-6da8d910cdac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:18.209189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1492232-3c0a-4178-ad92-6da8d910cdac None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:18.219069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 489/952] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:18.220279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1492232-3c0a-4178-ad92-6da8d910cdac None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:18.246396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:18.268312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88b503-74c7-4ac5-8aa2-5eb5d98834f2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:18.279367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:18.306017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18ba74-f807-42b7-b369-7a56182c1738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:18.306828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ba74-f807-42b7-b369-7a56182c1738 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.307204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ba74-f807-42b7-b369-7a56182c1738 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.307572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ba74-f807-42b7-b369-7a56182c1738 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.308338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18ba74-f807-42b7-b369-7a56182c1738 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:18.308740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18ba74-f807-42b7-b369-7a56182c1738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:18.310393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18ba74-f807-42b7-b369-7a56182c1738 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:18.342290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 464/953] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:44:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:18.353370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1492232-3c0a-4178-ad92-6da8d910cdac None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:18.364230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd3d97-48e7-47d2-8ae9-5161eeac9ebc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.364787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd3d97-48e7-47d2-8ae9-5161eeac9ebc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.364787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd3d97-48e7-47d2-8ae9-5161eeac9ebc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.366672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 465/954] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:18.373297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f7607-70a1-4701-a4d3-cc0508181e65 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.373623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f7607-70a1-4701-a4d3-cc0508181e65 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.373864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f7607-70a1-4701-a4d3-cc0508181e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.395138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-631f7607-70a1-4701-a4d3-cc0508181e65 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:18.396709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-631f7607-70a1-4701-a4d3-cc0508181e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:18.399799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03007-8bda-4518-a4f6-f0d0f7d46b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:18.400703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03007-8bda-4518-a4f6-f0d0f7d46b52 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.401053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03007-8bda-4518-a4f6-f0d0f7d46b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.401382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03007-8bda-4518-a4f6-f0d0f7d46b52 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.402118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03007-8bda-4518-a4f6-f0d0f7d46b52 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:18.402485 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03007-8bda-4518-a4f6-f0d0f7d46b52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:18.403967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03007-8bda-4518-a4f6-f0d0f7d46b52 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:18.409913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 490/955] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:18.415736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03007-8bda-4518-a4f6-f0d0f7d46b52 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:18.490118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 466/956] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:18.519787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:18.537421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03007-8bda-4518-a4f6-f0d0f7d46b52 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:18.573007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9323d-d100-4629-a8c6-f5f8133f86c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:18.573615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9323d-d100-4629-a8c6-f5f8133f86c3 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.573892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9323d-d100-4629-a8c6-f5f8133f86c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.574183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9323d-d100-4629-a8c6-f5f8133f86c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.574853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9323d-d100-4629-a8c6-f5f8133f86c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:18.576219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9323d-d100-4629-a8c6-f5f8133f86c3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:18.698119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 491/957] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:44:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:44:18.764579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f7607-70a1-4701-a4d3-cc0508181e65 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:18.874994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:18.881073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f7607-70a1-4701-a4d3-cc0508181e65 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:18.926668 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1279a-69dc-4042-b2c8-44ad0e19ae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:18.927779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1279a-69dc-4042-b2c8-44ad0e19ae73 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.928840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1279a-69dc-4042-b2c8-44ad0e19ae73 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.929318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1279a-69dc-4042-b2c8-44ad0e19ae73 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.930066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1279a-69dc-4042-b2c8-44ad0e19ae73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:18.931635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1279a-69dc-4042-b2c8-44ad0e19ae73 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-54d1279a-69dc-4042-b2c8-44ad0e19ae73 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:18.943783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:18.944882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:18.945733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 467/958] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:18.952428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9323d-d100-4629-a8c6-f5f8133f86c3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:19.055313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9323d-d100-4629-a8c6-f5f8133f86c3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:19.089955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef596d5d-ccbb-40af-8f10-1a3404d11492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:19.090590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef596d5d-ccbb-40af-8f10-1a3404d11492 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:19.090869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef596d5d-ccbb-40af-8f10-1a3404d11492 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:19.091141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef596d5d-ccbb-40af-8f10-1a3404d11492 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:19.091773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef596d5d-ccbb-40af-8f10-1a3404d11492 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:19.092072 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef596d5d-ccbb-40af-8f10-1a3404d11492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:19.093447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef596d5d-ccbb-40af-8f10-1a3404d11492 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:19.098584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 492/959] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:44:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:19.104848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1279a-69dc-4042-b2c8-44ad0e19ae73 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:19.217615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1279a-69dc-4042-b2c8-44ad0e19ae73 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:19.253345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ed28d-01d1-43b1-8a38-fb9f3369097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:19.253968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ed28d-01d1-43b1-8a38-fb9f3369097d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:19.254290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ed28d-01d1-43b1-8a38-fb9f3369097d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:19.254613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ed28d-01d1-43b1-8a38-fb9f3369097d None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:19.255312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ed28d-01d1-43b1-8a38-fb9f3369097d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:19.255637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ed28d-01d1-43b1-8a38-fb9f3369097d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:19.257176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ed28d-01d1-43b1-8a38-fb9f3369097d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:19.262430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 468/960] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:44:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:19.280729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f3ac5-b84f-43b1-9441-1f696cdfcb18 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:19.281072 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f3ac5-b84f-43b1-9441-1f696cdfcb18 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:19.281279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f3ac5-b84f-43b1-9441-1f696cdfcb18 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:19.283019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 493/961] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:19.289693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfe032-ade3-4ac6-bb12-5a3502708ff4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:19.290047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfe032-ade3-4ac6-bb12-5a3502708ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:19.290348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfe032-ade3-4ac6-bb12-5a3502708ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:19.310317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c5dfe032-ade3-4ac6-bb12-5a3502708ff4 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:19.311675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c5dfe032-ade3-4ac6-bb12-5a3502708ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:19.331357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:19.389904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 469/962] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:19.658131 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f3ac5-b84f-43b1-9441-1f696cdfcb18 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:19.662034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:19.766528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f3ac5-b84f-43b1-9441-1f696cdfcb18 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:19.801354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22667636-2f05-4b23-9ed7-7dc229052b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:19.802040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22667636-2f05-4b23-9ed7-7dc229052b13 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:19.802345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22667636-2f05-4b23-9ed7-7dc229052b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:19.802619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22667636-2f05-4b23-9ed7-7dc229052b13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:19.813526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22667636-2f05-4b23-9ed7-7dc229052b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-22667636-2f05-4b23-9ed7-7dc229052b13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:19.818318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:19.825689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:19.826631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 494/963] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 08:44:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:19.831155 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfe032-ade3-4ac6-bb12-5a3502708ff4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:19.933956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfe032-ade3-4ac6-bb12-5a3502708ff4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:19.968166 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01fdf-aa00-4050-b9de-e2888d6ccc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:19.968778 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01fdf-aa00-4050-b9de-e2888d6ccc95 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:19.969057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01fdf-aa00-4050-b9de-e2888d6ccc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:19.969331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b01fdf-aa00-4050-b9de-e2888d6ccc95 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:19.969996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b01fdf-aa00-4050-b9de-e2888d6ccc95 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:19.970324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b01fdf-aa00-4050-b9de-e2888d6ccc95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:19.971689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b01fdf-aa00-4050-b9de-e2888d6ccc95 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:19.981093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 470/964] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 08:44:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:19.986666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22667636-2f05-4b23-9ed7-7dc229052b13 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:20.070488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:20.090980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22667636-2f05-4b23-9ed7-7dc229052b13 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:20.126618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8fab-55f9-43b8-a65f-d8ffb5c77038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:20.127565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8fab-55f9-43b8-a65f-d8ffb5c77038 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:20.128022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8fab-55f9-43b8-a65f-d8ffb5c77038 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:20.128466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c8fab-55f9-43b8-a65f-d8ffb5c77038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:20.138956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8fab-55f9-43b8-a65f-d8ffb5c77038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:20.140637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c8fab-55f9-43b8-a65f-d8ffb5c77038 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-628c8fab-55f9-43b8-a65f-d8ffb5c77038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:20.156463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:20.157442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:20.158367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:20.158367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:20.158367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:20.160299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 495/965] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:20.166929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01fdf-aa00-4050-b9de-e2888d6ccc95 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:20.184811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:20.269359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b01fdf-aa00-4050-b9de-e2888d6ccc95 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:20.305374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2d0e2-402e-4903-961c-bfd1569e2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:20.306270 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2d0e2-402e-4903-961c-bfd1569e2258 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:20.306698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2d0e2-402e-4903-961c-bfd1569e2258 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:20.307143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2d0e2-402e-4903-961c-bfd1569e2258 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:20.307930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2d0e2-402e-4903-961c-bfd1569e2258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:20.308379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2d0e2-402e-4903-961c-bfd1569e2258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:20.309881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2d0e2-402e-4903-961c-bfd1569e2258 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:20.321780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 471/966] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:20.326986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8fab-55f9-43b8-a65f-d8ffb5c77038 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:20.428049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c8fab-55f9-43b8-a65f-d8ffb5c77038 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:20.445016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:20.463101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1025cab-e1e2-479e-8ac9-334a794cc601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:20.463738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1025cab-e1e2-479e-8ac9-334a794cc601 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:20.471024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1025cab-e1e2-479e-8ac9-334a794cc601 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:20.471024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1025cab-e1e2-479e-8ac9-334a794cc601 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:20.471999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1025cab-e1e2-479e-8ac9-334a794cc601 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:20.473481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1025cab-e1e2-479e-8ac9-334a794cc601 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c1025cab-e1e2-479e-8ac9-334a794cc601 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:44:20.485539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:20.486564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:20.487610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 496/967] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:44:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:20.493138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2d0e2-402e-4903-961c-bfd1569e2258 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:20.572394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:20.598514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2d0e2-402e-4903-961c-bfd1569e2258 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:20.637727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2de8e-0d47-498d-afc8-a5d79a56f03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:20.638426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2de8e-0d47-498d-afc8-a5d79a56f03a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:20.638708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2de8e-0d47-498d-afc8-a5d79a56f03a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:20.638979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2de8e-0d47-498d-afc8-a5d79a56f03a None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:20.639722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2de8e-0d47-498d-afc8-a5d79a56f03a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:20.640030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2de8e-0d47-498d-afc8-a5d79a56f03a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:20.641466 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2de8e-0d47-498d-afc8-a5d79a56f03a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:20.659652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 472/968] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Oct 4 08:44:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:20.667438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1025cab-e1e2-479e-8ac9-334a794cc601 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:20.729473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90279-2b08-4e17-b7b6-12d4e6a252b5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:20.729775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90279-2b08-4e17-b7b6-12d4e6a252b5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:20.729999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90279-2b08-4e17-b7b6-12d4e6a252b5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:20.732773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 473/969] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:20.736996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460a11d-f474-4af1-920b-ae30d1487c7a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:20.737284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460a11d-f474-4af1-920b-ae30d1487c7a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:20.737562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460a11d-f474-4af1-920b-ae30d1487c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:20.762848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9460a11d-f474-4af1-920b-ae30d1487c7a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:20.764354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9460a11d-f474-4af1-920b-ae30d1487c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:20.776441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1025cab-e1e2-479e-8ac9-334a794cc601 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:20.812806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65423d0-dcc5-42c2-91db-da8b57a4a2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:20.813867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65423d0-dcc5-42c2-91db-da8b57a4a2cd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:20.814397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65423d0-dcc5-42c2-91db-da8b57a4a2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:20.814829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65423d0-dcc5-42c2-91db-da8b57a4a2cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:20.840901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 474/970] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:20.891892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65423d0-dcc5-42c2-91db-da8b57a4a2cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:20.893786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65423d0-dcc5-42c2-91db-da8b57a4a2cd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:20.898371 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:21.001081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 497/971] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:20 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:21.010856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460a11d-f474-4af1-920b-ae30d1487c7a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.025422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976be536-9a84-4e27-9d78-4795744eee2e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.025715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976be536-9a84-4e27-9d78-4795744eee2e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.025976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976be536-9a84-4e27-9d78-4795744eee2e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.027493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 498/972] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:21.032565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17195c72-f43e-44a8-90f9-65884dbb6a66 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.032843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17195c72-f43e-44a8-90f9-65884dbb6a66 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.033112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17195c72-f43e-44a8-90f9-65884dbb6a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.052617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-17195c72-f43e-44a8-90f9-65884dbb6a66 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:21.054452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-17195c72-f43e-44a8-90f9-65884dbb6a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:21.091407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:21.134127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 499/973] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:21.135311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17195c72-f43e-44a8-90f9-65884dbb6a66 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.143675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:21.147871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460a11d-f474-4af1-920b-ae30d1487c7a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:21.190128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f2bb2-d5d5-4eb7-ad1d-d4461eb2c023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:21.190809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f2bb2-d5d5-4eb7-ad1d-d4461eb2c023 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.191090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f2bb2-d5d5-4eb7-ad1d-d4461eb2c023 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.191365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f2bb2-d5d5-4eb7-ad1d-d4461eb2c023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.203289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f2bb2-d5d5-4eb7-ad1d-d4461eb2c023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:21.204953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f2bb2-d5d5-4eb7-ad1d-d4461eb2c023 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6f0f2bb2-d5d5-4eb7-ad1d-d4461eb2c023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:21.221052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:21.222011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:21.228140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:21.228140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:21.228140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:21.228140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 475/974] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:21.229447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f2bb2-d5d5-4eb7-ad1d-d4461eb2c023 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.270511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17195c72-f43e-44a8-90f9-65884dbb6a66 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:21.310128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:21.310674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.310953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.311224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.311869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:21.313306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:21.315848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING keystone.server.flask.common [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 08:44:21.344775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f2bb2-d5d5-4eb7-ad1d-d4461eb2c023 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:21.359511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:21.374931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:44:21.374931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 08:44:21.374931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [parameters: {'user_id': '91faa598c4c047648cb435fdb9c0d034', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 08:44:21.374931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:44:21.378752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa0753-6372-44ce-a42d-0754e8149c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:21.379363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa0753-6372-44ce-a42d-0754e8149c4b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.379738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa0753-6372-44ce-a42d-0754e8149c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.379979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa0753-6372-44ce-a42d-0754e8149c4b None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.380624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa0753-6372-44ce-a42d-0754e8149c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:21.380929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa0753-6372-44ce-a42d-0754e8149c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:21.382862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa0753-6372-44ce-a42d-0754e8149c4b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Oct 04 08:44:21.385463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:44:21.386434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:44:21.387385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:44:21.388360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:44:21.389268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:44:21.392934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'user_id': '91faa598c4c047648cb435fdb9c0d034', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:21.395068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 08:44:21.397831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 08:44:21.403390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 08:44:21.403390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 08:44:21.403390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:44:21.403390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:44:21.403390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 08:44:21.403390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:21.404162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 476/975] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:21.404307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 500/976] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Oct 4 08:44:21 2022] POST /identity/v3/users => generated 160 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:21.404739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa0753-6372-44ce-a42d-0754e8149c4b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.405888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.478918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:21.513614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa0753-6372-44ce-a42d-0754e8149c4b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:21.514174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ed516-7695-4ab8-a8e2-50d32b4e1fc5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:21.548419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d746ec8-ffa3-4600-a468-04c01511bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:21.548612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3dc39-8cd4-4c70-af2a-b15d4552fe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:21.548962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3dc39-8cd4-4c70-af2a-b15d4552fe8f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.549061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746ec8-ffa3-4600-a468-04c01511bd70 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.549242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3dc39-8cd4-4c70-af2a-b15d4552fe8f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.549385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746ec8-ffa3-4600-a468-04c01511bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.549540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3dc39-8cd4-4c70-af2a-b15d4552fe8f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.549671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d746ec8-ffa3-4600-a468-04c01511bd70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.550109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3dc39-8cd4-4c70-af2a-b15d4552fe8f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:21.551676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3dc39-8cd4-4c70-af2a-b15d4552fe8f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:21.556194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d746ec8-ffa3-4600-a468-04c01511bd70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:21.557613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d746ec8-ffa3-4600-a468-04c01511bd70 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9ac3dc39-8cd4-4c70-af2a-b15d4552fe8f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:21.560329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:21.561302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:21.562201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 501/977] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:21.563038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3dc39-8cd4-4c70-af2a-b15d4552fe8f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2d746ec8-ffa3-4600-a468-04c01511bd70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:21.572129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:21.573604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 477/978] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0994e-7ddc-48a7-816e-9b386d8b01df None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.575062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0994e-7ddc-48a7-816e-9b386d8b01df None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.575835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0994e-7ddc-48a7-816e-9b386d8b01df None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.576242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 478/979] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:21.576826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0994e-7ddc-48a7-816e-9b386d8b01df None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.612090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:21.663836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3dc39-8cd4-4c70-af2a-b15d4552fe8f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:21.677692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0994e-7ddc-48a7-816e-9b386d8b01df None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:21.694907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:21.700372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83953db7-5b41-4493-82f0-cd6e373c4707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:21.701001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953db7-5b41-4493-82f0-cd6e373c4707 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.701280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953db7-5b41-4493-82f0-cd6e373c4707 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.701559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83953db7-5b41-4493-82f0-cd6e373c4707 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.708550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83953db7-5b41-4493-82f0-cd6e373c4707 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:21.710045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83953db7-5b41-4493-82f0-cd6e373c4707 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:21.711855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff171a5e-0945-426c-b13f-cacf07a93c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:21.712450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff171a5e-0945-426c-b13f-cacf07a93c6b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.712734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff171a5e-0945-426c-b13f-cacf07a93c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.713008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff171a5e-0945-426c-b13f-cacf07a93c6b None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.713640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff171a5e-0945-426c-b13f-cacf07a93c6b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:21.713941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff171a5e-0945-426c-b13f-cacf07a93c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:21.715406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff171a5e-0945-426c-b13f-cacf07a93c6b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:21.719925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 479/980] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-83953db7-5b41-4493-82f0-cd6e373c4707 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:44:21.721426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:21.722580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:44:21.723736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:21.724972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff171a5e-0945-426c-b13f-cacf07a93c6b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.725414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 502/981] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:21.726735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e9d9-b8d6-46d1-a87d-166620154b88 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.727021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e9d9-b8d6-46d1-a87d-166620154b88 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.727295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e9d9-b8d6-46d1-a87d-166620154b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.747913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ead5e9d9-b8d6-46d1-a87d-166620154b88 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:21.749529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ead5e9d9-b8d6-46d1-a87d-166620154b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:21.816571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 503/982] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:21.817322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5e9d9-b8d6-46d1-a87d-166620154b88 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.823275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:21.828125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff171a5e-0945-426c-b13f-cacf07a93c6b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:21.864924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3d217-6765-47cb-acef-51a3b82a8b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:21.866166 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3d217-6765-47cb-acef-51a3b82a8b6f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.866472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3d217-6765-47cb-acef-51a3b82a8b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.866749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3d217-6765-47cb-acef-51a3b82a8b6f None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.867469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3d217-6765-47cb-acef-51a3b82a8b6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:21.867752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3d217-6765-47cb-acef-51a3b82a8b6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:21.869185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3d217-6765-47cb-acef-51a3b82a8b6f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:21.881896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 480/983] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:21.882821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3d217-6765-47cb-acef-51a3b82a8b6f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.925177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5e9d9-b8d6-46d1-a87d-166620154b88 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:21.955453 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:21.966504 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e98ab7-6d3d-4c82-bf84-0b1cfd415281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:21.967113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e98ab7-6d3d-4c82-bf84-0b1cfd415281 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:21.967426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e98ab7-6d3d-4c82-bf84-0b1cfd415281 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:21.967752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e98ab7-6d3d-4c82-bf84-0b1cfd415281 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:21.968392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e98ab7-6d3d-4c82-bf84-0b1cfd415281 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:21.968701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e98ab7-6d3d-4c82-bf84-0b1cfd415281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:21.970128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e98ab7-6d3d-4c82-bf84-0b1cfd415281 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:21.978868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 504/984] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:21.979923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e98ab7-6d3d-4c82-bf84-0b1cfd415281 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:21.996942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3d217-6765-47cb-acef-51a3b82a8b6f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:22.033837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc74fd-1223-4492-ba18-cdcc79154131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:22.034472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc74fd-1223-4492-ba18-cdcc79154131 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:22.034760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc74fd-1223-4492-ba18-cdcc79154131 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:22.035036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc74fd-1223-4492-ba18-cdcc79154131 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:22.036415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc74fd-1223-4492-ba18-cdcc79154131 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:22.036733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc74fd-1223-4492-ba18-cdcc79154131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:22.039160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc74fd-1223-4492-ba18-cdcc79154131 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:22.080334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e98ab7-6d3d-4c82-bf84-0b1cfd415281 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:22.080859 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 481/985] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:22.090322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc74fd-1223-4492-ba18-cdcc79154131 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:22.109391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:22.129659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94edd0-bfa3-45b9-bc56-a8c4b30b960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:22.130304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94edd0-bfa3-45b9-bc56-a8c4b30b960d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:22.130585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94edd0-bfa3-45b9-bc56-a8c4b30b960d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:22.130854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94edd0-bfa3-45b9-bc56-a8c4b30b960d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:22.132129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94edd0-bfa3-45b9-bc56-a8c4b30b960d None admin] RBAC: Adding query filter params (role.id=a3ff1ddfe66c4d2eba431a612b81a285, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=afdc2662bd3148e3b120427adcc1a12b) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:22.132439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94edd0-bfa3-45b9-bc56-a8c4b30b960d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:22.133991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94edd0-bfa3-45b9-bc56-a8c4b30b960d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:22.140697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 505/986] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:21 2022] GET /identity/v3/role_assignments?user.id=afdc2662bd3148e3b120427adcc1a12b&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a3ff1ddfe66c4d2eba431a612b81a285 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:22.141551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94edd0-bfa3-45b9-bc56-a8c4b30b960d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:22.202140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:22.233989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc74fd-1223-4492-ba18-cdcc79154131 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:22.262915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94edd0-bfa3-45b9-bc56-a8c4b30b960d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:22.285262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ff5ef-5c2e-43ef-a34a-af283e12b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:22.285905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ff5ef-5c2e-43ef-a34a-af283e12b37d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:22.286289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ff5ef-5c2e-43ef-a34a-af283e12b37d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:22.286613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ff5ef-5c2e-43ef-a34a-af283e12b37d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:22.287408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ff5ef-5c2e-43ef-a34a-af283e12b37d None admin] RBAC: Adding query filter params (interface=admin, service_id=05aafa816faa460ab71539601ef06f66, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:22.288285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ff5ef-5c2e-43ef-a34a-af283e12b37d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:22.289715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ff5ef-5c2e-43ef-a34a-af283e12b37d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:22.298259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 482/987] 10.222.0.33 () {56 vars in 1249 bytes} [Tue Oct 4 08:44:22 2022] GET /identity/v3/endpoints?service_id=05aafa816faa460ab71539601ef06f66&interface=admin®ion_id=RegionOne => generated 193 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:22.301619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ff5ef-5c2e-43ef-a34a-af283e12b37d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:22.313564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e00e2-44da-4bb0-9b1b-040bd2f7091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:22.314237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e00e2-44da-4bb0-9b1b-040bd2f7091e None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:22.314524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e00e2-44da-4bb0-9b1b-040bd2f7091e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:22.314797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e00e2-44da-4bb0-9b1b-040bd2f7091e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:22.315469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e00e2-44da-4bb0-9b1b-040bd2f7091e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:22.316874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e00e2-44da-4bb0-9b1b-040bd2f7091e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:22.390633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 506/988] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:44:22 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:22.391663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:22.415486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ff5ef-5c2e-43ef-a34a-af283e12b37d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:22.463156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52712a-0f8f-4500-8cd0-4a9431f44a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:22.463786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52712a-0f8f-4500-8cd0-4a9431f44a87 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:22.464065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52712a-0f8f-4500-8cd0-4a9431f44a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:22.464336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52712a-0f8f-4500-8cd0-4a9431f44a87 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:22.464953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52712a-0f8f-4500-8cd0-4a9431f44a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:22.466393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52712a-0f8f-4500-8cd0-4a9431f44a87 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:22.473603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 483/989] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 08:44:22 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:44:24.361759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a7f81-869d-4034-83f5-93a24c38c596 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:24.362291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a7f81-869d-4034-83f5-93a24c38c596 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:24.362369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a7f81-869d-4034-83f5-93a24c38c596 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:24.363732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 507/990] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:24.369404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36722c0e-2a31-4b01-99f6-3e55c497a586 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:24.369802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36722c0e-2a31-4b01-99f6-3e55c497a586 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:24.369958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36722c0e-2a31-4b01-99f6-3e55c497a586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:24.389286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-36722c0e-2a31-4b01-99f6-3e55c497a586 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:24.390523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-36722c0e-2a31-4b01-99f6-3e55c497a586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:24.457551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 484/991] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:24.579427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aee60-7a0f-4f0c-b181-16902f9d3b55 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:24.579762 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aee60-7a0f-4f0c-b181-16902f9d3b55 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:24.579985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aee60-7a0f-4f0c-b181-16902f9d3b55 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:24.581479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 508/992] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:24.587024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a777a9-c50f-4b1a-be76-4a5b9868abe2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:24.587321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a777a9-c50f-4b1a-be76-4a5b9868abe2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:24.587602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a777a9-c50f-4b1a-be76-4a5b9868abe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:24.606854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-29a777a9-c50f-4b1a-be76-4a5b9868abe2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:24.608045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-29a777a9-c50f-4b1a-be76-4a5b9868abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:24.622872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb6187-de44-4b4e-a963-9e818745d89f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:24.623088 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb6187-de44-4b4e-a963-9e818745d89f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:24.623366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb6187-de44-4b4e-a963-9e818745d89f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:24.624971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 509/993] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:24.629595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411a49-0ba6-4423-815c-fe77a2a405cb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:24.629894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411a49-0ba6-4423-815c-fe77a2a405cb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:24.630212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411a49-0ba6-4423-815c-fe77a2a405cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:24.648762 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ce411a49-0ba6-4423-815c-fe77a2a405cb None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:24.649956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ce411a49-0ba6-4423-815c-fe77a2a405cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:24.681015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:24.686132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 485/994] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:24.720324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 510/995] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:24.726442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a777a9-c50f-4b1a-be76-4a5b9868abe2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:24.825677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a777a9-c50f-4b1a-be76-4a5b9868abe2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:24.859972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d139-2a84-4ca1-acf7-a465af57ba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:24.860600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d139-2a84-4ca1-acf7-a465af57ba01 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:24.860882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d139-2a84-4ca1-acf7-a465af57ba01 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:24.861151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46d139-2a84-4ca1-acf7-a465af57ba01 None admin] PATH_INFO: `/v3/services/image` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:24.861734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46d139-2a84-4ca1-acf7-a465af57ba01 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:24.863129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46d139-2a84-4ca1-acf7-a465af57ba01 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6a46d139-2a84-4ca1-acf7-a465af57ba01 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:24.871880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:24.872930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:44:24.873794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:24.877895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 486/996] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Oct 4 08:44:24 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:24.879172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce411a49-0ba6-4423-815c-fe77a2a405cb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:24.924486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:24.956393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d139-2a84-4ca1-acf7-a465af57ba01 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:24.993338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce411a49-0ba6-4423-815c-fe77a2a405cb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.022192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:25.028467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e19b7-3062-4f3f-a5ff-cf27ab898633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.029082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e19b7-3062-4f3f-a5ff-cf27ab898633 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.029365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e19b7-3062-4f3f-a5ff-cf27ab898633 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.029643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e19b7-3062-4f3f-a5ff-cf27ab898633 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.030310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e19b7-3062-4f3f-a5ff-cf27ab898633 None admin] RBAC: Adding query filter params (name=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:25.030617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e19b7-3062-4f3f-a5ff-cf27ab898633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.032024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e19b7-3062-4f3f-a5ff-cf27ab898633 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.036695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 511/997] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:25.038026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e19b7-3062-4f3f-a5ff-cf27ab898633 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:25.060170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46d139-2a84-4ca1-acf7-a465af57ba01 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.092855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f25568-3198-47ce-9bcd-a8f6a8c9c17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.093484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f25568-3198-47ce-9bcd-a8f6a8c9c17f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.093770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f25568-3198-47ce-9bcd-a8f6a8c9c17f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.094045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f25568-3198-47ce-9bcd-a8f6a8c9c17f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.094669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f25568-3198-47ce-9bcd-a8f6a8c9c17f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.096074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f25568-3198-47ce-9bcd-a8f6a8c9c17f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-25f25568-3198-47ce-9bcd-a8f6a8c9c17f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:25.106121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:25.107188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:25.108034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 487/998] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:25.109356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f25568-3198-47ce-9bcd-a8f6a8c9c17f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:25.142936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e19b7-3062-4f3f-a5ff-cf27ab898633 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.145136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:25.177370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1bc7f-a2f8-4fda-aa41-e49a65c2d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.179308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1bc7f-a2f8-4fda-aa41-e49a65c2d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.179595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1bc7f-a2f8-4fda-aa41-e49a65c2d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.179904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1bc7f-a2f8-4fda-aa41-e49a65c2d3d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.180489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1bc7f-a2f8-4fda-aa41-e49a65c2d3d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.181852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1bc7f-a2f8-4fda-aa41-e49a65c2d3d3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-48e1bc7f-a2f8-4fda-aa41-e49a65c2d3d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:25.191544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:25.192677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:25.194103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 512/999] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Oct 4 08:44:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:25.194925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1bc7f-a2f8-4fda-aa41-e49a65c2d3d3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:25.213442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f25568-3198-47ce-9bcd-a8f6a8c9c17f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.240249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:25.248422 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5e1e-eaea-4156-89f4-4961caa8205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.249024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5e1e-eaea-4156-89f4-4961caa8205a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.255382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5e1e-eaea-4156-89f4-4961caa8205a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.255382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b5e1e-eaea-4156-89f4-4961caa8205a None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.255382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5e1e-eaea-4156-89f4-4961caa8205a None admin] RBAC: Adding query filter params (type=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:25.255382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5e1e-eaea-4156-89f4-4961caa8205a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.255382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b5e1e-eaea-4156-89f4-4961caa8205a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.262326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 488/1000] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:25.262326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5e1e-eaea-4156-89f4-4961caa8205a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:25.299628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1bc7f-a2f8-4fda-aa41-e49a65c2d3d3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.339723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b425c4-9e55-4d43-bd0a-93a8baf59450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.340950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b425c4-9e55-4d43-bd0a-93a8baf59450 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.341348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b425c4-9e55-4d43-bd0a-93a8baf59450 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.341627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b425c4-9e55-4d43-bd0a-93a8baf59450 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.342307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b425c4-9e55-4d43-bd0a-93a8baf59450 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:25.342613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b425c4-9e55-4d43-bd0a-93a8baf59450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.344188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b425c4-9e55-4d43-bd0a-93a8baf59450 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.351397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 513/1001] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:44:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:25.357284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b425c4-9e55-4d43-bd0a-93a8baf59450 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:25.383024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b5e1e-eaea-4156-89f4-4961caa8205a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.395248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:25.420027 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d26b4b-725e-45dc-ade1-4fc18952bb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.420646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d26b4b-725e-45dc-ade1-4fc18952bb33 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.420932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d26b4b-725e-45dc-ade1-4fc18952bb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.421207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d26b4b-725e-45dc-ade1-4fc18952bb33 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.421848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d26b4b-725e-45dc-ade1-4fc18952bb33 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:25.422188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d26b4b-725e-45dc-ade1-4fc18952bb33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.423570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d26b4b-725e-45dc-ade1-4fc18952bb33 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.430581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 489/1002] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:25.437532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d26b4b-725e-45dc-ade1-4fc18952bb33 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:25.475337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b425c4-9e55-4d43-bd0a-93a8baf59450 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.497323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:25.511349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7aec0-fe68-4379-bfe0-591d884ec529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.511963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7aec0-fe68-4379-bfe0-591d884ec529 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.515897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7aec0-fe68-4379-bfe0-591d884ec529 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.515897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7aec0-fe68-4379-bfe0-591d884ec529 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.515897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7aec0-fe68-4379-bfe0-591d884ec529 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:25.515897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7aec0-fe68-4379-bfe0-591d884ec529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.515897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7aec0-fe68-4379-bfe0-591d884ec529 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.520279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 514/1003] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:44:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:25.526912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7aec0-fe68-4379-bfe0-591d884ec529 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:25.546172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d26b4b-725e-45dc-ade1-4fc18952bb33 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.582794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d62efd-9027-41f0-b2d8-76c84e60fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.583727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d62efd-9027-41f0-b2d8-76c84e60fd27 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.584728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d62efd-9027-41f0-b2d8-76c84e60fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.584998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d62efd-9027-41f0-b2d8-76c84e60fd27 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.585635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d62efd-9027-41f0-b2d8-76c84e60fd27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:25.586048 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d62efd-9027-41f0-b2d8-76c84e60fd27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.587681 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d62efd-9027-41f0-b2d8-76c84e60fd27 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.593098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 490/1004] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Oct 4 08:44:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:25.598474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d62efd-9027-41f0-b2d8-76c84e60fd27 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:25.622275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:25.628914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7aec0-fe68-4379-bfe0-591d884ec529 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.665356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc17f-fc14-48b8-9b87-33a56ee89ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.665899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc17f-fc14-48b8-9b87-33a56ee89ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.666210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc17f-fc14-48b8-9b87-33a56ee89ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.666489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc17f-fc14-48b8-9b87-33a56ee89ff7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.667196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fc17f-fc14-48b8-9b87-33a56ee89ff7 None admin] RBAC: Adding query filter params (interface=public, service_id=282fae5852e048d4886d00a8c658938d, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:25.667573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fc17f-fc14-48b8-9b87-33a56ee89ff7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.668893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fc17f-fc14-48b8-9b87-33a56ee89ff7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.673883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 515/1005] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 08:44:25 2022] GET /identity/v3/endpoints?service_id=282fae5852e048d4886d00a8c658938d&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:25.679905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc17f-fc14-48b8-9b87-33a56ee89ff7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:25.710416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d62efd-9027-41f0-b2d8-76c84e60fd27 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.730358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:25.747302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee3184-ff6f-49dd-8776-bb5eefbe6bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.748006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3184-ff6f-49dd-8776-bb5eefbe6bb3 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.748360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3184-ff6f-49dd-8776-bb5eefbe6bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.748710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3184-ff6f-49dd-8776-bb5eefbe6bb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.749454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee3184-ff6f-49dd-8776-bb5eefbe6bb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.751011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee3184-ff6f-49dd-8776-bb5eefbe6bb3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.783505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc17f-fc14-48b8-9b87-33a56ee89ff7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:25.816857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbf6cf-2358-4d8c-839a-829d45d7aec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:25.817467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbf6cf-2358-4d8c-839a-829d45d7aec4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.817752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbf6cf-2358-4d8c-839a-829d45d7aec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.818029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbf6cf-2358-4d8c-839a-829d45d7aec4 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.819243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbf6cf-2358-4d8c-839a-829d45d7aec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:25.820614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbf6cf-2358-4d8c-839a-829d45d7aec4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:25.826956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 516/1006] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 08:44:25 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:44:25.880370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 491/1007] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:44:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:27.439514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2630f94-2d75-49b2-a7ef-e170bd2c8086 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:27.440078 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2630f94-2d75-49b2-a7ef-e170bd2c8086 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:27.440078 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2630f94-2d75-49b2-a7ef-e170bd2c8086 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:27.441402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 517/1008] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:27.447202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493d153-7563-49cf-99d6-c45336536a0e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:27.447590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493d153-7563-49cf-99d6-c45336536a0e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:27.447781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493d153-7563-49cf-99d6-c45336536a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:27.466339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0493d153-7563-49cf-99d6-c45336536a0e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:27.467516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0493d153-7563-49cf-99d6-c45336536a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:27.539457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 492/1009] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:27.807010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2630f94-2d75-49b2-a7ef-e170bd2c8086 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:27.831641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:27.915902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2630f94-2d75-49b2-a7ef-e170bd2c8086 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:27.956166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121850e7-e8b1-47cf-9628-5fa9b250eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:27.956793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121850e7-e8b1-47cf-9628-5fa9b250eb83 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:27.957067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121850e7-e8b1-47cf-9628-5fa9b250eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:27.957339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121850e7-e8b1-47cf-9628-5fa9b250eb83 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:27.958027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121850e7-e8b1-47cf-9628-5fa9b250eb83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:27.960067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121850e7-e8b1-47cf-9628-5fa9b250eb83 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:27.994506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bda03-17f5-45e7-aac7-3f1632c549e0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:27.994862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bda03-17f5-45e7-aac7-3f1632c549e0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:27.995204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bda03-17f5-45e7-aac7-3f1632c549e0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:27.996767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 493/1010] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:28.001662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c3f4d-a17b-43b5-9bb8-9252a823a79e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:28.001968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c3f4d-a17b-43b5-9bb8-9252a823a79e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:28.003900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c3f4d-a17b-43b5-9bb8-9252a823a79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:28.020533 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a56c3f4d-a17b-43b5-9bb8-9252a823a79e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:28.022306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a56c3f4d-a17b-43b5-9bb8-9252a823a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:28.062592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 518/1011] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:44:27 2022] POST /identity/v3/services => generated 242 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:28.067982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1ab4-53fc-4226-98e1-0f3d3c87f2b8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:28.068805 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1ab4-53fc-4226-98e1-0f3d3c87f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:28.069289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1ab4-53fc-4226-98e1-0f3d3c87f2b8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:28.071012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 519/1012] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:28.079009 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43cb96-0748-477e-92a6-1cec7b46e762 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:28.079612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43cb96-0748-477e-92a6-1cec7b46e762 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:28.080082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43cb96-0748-477e-92a6-1cec7b46e762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:28.101426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7c43cb96-0748-477e-92a6-1cec7b46e762 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:28.102960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7c43cb96-0748-477e-92a6-1cec7b46e762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:28.106115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 494/1013] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:28 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:28.179328 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 520/1014] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:28 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:28.376306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c3f4d-a17b-43b5-9bb8-9252a823a79e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:28.406817 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:28.445512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43cb96-0748-477e-92a6-1cec7b46e762 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:28.461061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:28.478907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c3f4d-a17b-43b5-9bb8-9252a823a79e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:28.513414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a5905-33c1-4872-a03d-6fa6e861e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:28.514054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a5905-33c1-4872-a03d-6fa6e861e728 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:28.514364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a5905-33c1-4872-a03d-6fa6e861e728 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:28.514640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a5905-33c1-4872-a03d-6fa6e861e728 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:28.515231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a5905-33c1-4872-a03d-6fa6e861e728 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:28.516598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a5905-33c1-4872-a03d-6fa6e861e728 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-641a5905-33c1-4872-a03d-6fa6e861e728 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:28.525989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:28.527019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:28.527857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 495/1015] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:28.532951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a5905-33c1-4872-a03d-6fa6e861e728 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:28.558695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43cb96-0748-477e-92a6-1cec7b46e762 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:28.600213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55249ecc-d410-49ac-99eb-46570e577397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:28.600856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55249ecc-d410-49ac-99eb-46570e577397 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:28.601136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55249ecc-d410-49ac-99eb-46570e577397 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:28.601410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55249ecc-d410-49ac-99eb-46570e577397 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:28.602812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55249ecc-d410-49ac-99eb-46570e577397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:28.604248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55249ecc-d410-49ac-99eb-46570e577397 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:28.605831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 521/1016] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:28.611483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55249ecc-d410-49ac-99eb-46570e577397 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:28.630052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:28.636427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a5905-33c1-4872-a03d-6fa6e861e728 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:28.672120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b970f7-19d7-4b35-a6d5-58b01cd603d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:28.672733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b970f7-19d7-4b35-a6d5-58b01cd603d3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:28.672998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b970f7-19d7-4b35-a6d5-58b01cd603d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:28.673266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b970f7-19d7-4b35-a6d5-58b01cd603d3 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:28.673894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b970f7-19d7-4b35-a6d5-58b01cd603d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:28.674225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b970f7-19d7-4b35-a6d5-58b01cd603d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:28.675581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b970f7-19d7-4b35-a6d5-58b01cd603d3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:28.685579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 496/1017] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:44:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:28.686987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b970f7-19d7-4b35-a6d5-58b01cd603d3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:28.700427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:28.720497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55249ecc-d410-49ac-99eb-46570e577397 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:28.759326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ccab3-121e-45a5-93a4-e2d12723d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:28.759936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ccab3-121e-45a5-93a4-e2d12723d739 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:28.760218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ccab3-121e-45a5-93a4-e2d12723d739 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:28.760495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ccab3-121e-45a5-93a4-e2d12723d739 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:28.761169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ccab3-121e-45a5-93a4-e2d12723d739 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:28.762637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ccab3-121e-45a5-93a4-e2d12723d739 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:28.789720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b970f7-19d7-4b35-a6d5-58b01cd603d3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:28.825011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d355410-6079-41d3-b01b-e184bafbeede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:28.825620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d355410-6079-41d3-b01b-e184bafbeede None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:28.825899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d355410-6079-41d3-b01b-e184bafbeede None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:28.826241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d355410-6079-41d3-b01b-e184bafbeede None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:28.826835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d355410-6079-41d3-b01b-e184bafbeede None admin] RBAC: Adding query filter params (type=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:28.827138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d355410-6079-41d3-b01b-e184bafbeede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:28.828497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d355410-6079-41d3-b01b-e184bafbeede None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:28.833370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 497/1018] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Oct 4 08:44:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:28.838974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d355410-6079-41d3-b01b-e184bafbeede None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:28.864178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:28.921921 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 522/1019] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:44:28 2022] POST /identity/v3/projects => generated 311 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:44:28.947098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d355410-6079-41d3-b01b-e184bafbeede None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:28.988162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffc8b4-90ff-40d1-9279-2203482d9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:28.988798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc8b4-90ff-40d1-9279-2203482d9eef None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:28.989080 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc8b4-90ff-40d1-9279-2203482d9eef None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:28.989353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffc8b4-90ff-40d1-9279-2203482d9eef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:28.990036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc8b4-90ff-40d1-9279-2203482d9eef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:28.992050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffc8b4-90ff-40d1-9279-2203482d9eef None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:29.072451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 498/1020] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:44:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:44:30.276358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4571926-5d7e-4e8d-bbc0-386e62e9f5d1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:30.276850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4571926-5d7e-4e8d-bbc0-386e62e9f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:30.276850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4571926-5d7e-4e8d-bbc0-386e62e9f5d1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:30.278365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 523/1021] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:30.283799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee37bcc-93c3-4034-afc8-0677ae6757cb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:30.284197 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee37bcc-93c3-4034-afc8-0677ae6757cb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:30.284381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee37bcc-93c3-4034-afc8-0677ae6757cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:30.303455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3ee37bcc-93c3-4034-afc8-0677ae6757cb None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:30.304643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3ee37bcc-93c3-4034-afc8-0677ae6757cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:30.376390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 499/1022] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:30.645943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4571926-5d7e-4e8d-bbc0-386e62e9f5d1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:30.748801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4571926-5d7e-4e8d-bbc0-386e62e9f5d1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:30.784094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1d586-97e7-4b9b-b064-eca0beda4b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:30.784786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d586-97e7-4b9b-b064-eca0beda4b45 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:30.785067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d586-97e7-4b9b-b064-eca0beda4b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:30.785344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1d586-97e7-4b9b-b064-eca0beda4b45 None admin] PATH_INFO: `/v3/services/image` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:30.785933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1d586-97e7-4b9b-b064-eca0beda4b45 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:30.787895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1d586-97e7-4b9b-b064-eca0beda4b45 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:30.789631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d8c1d586-97e7-4b9b-b064-eca0beda4b45 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:30.797894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:30.798915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:44:30.799809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:30.802163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 524/1023] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Oct 4 08:44:30 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:30.805475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee37bcc-93c3-4034-afc8-0677ae6757cb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:30.813981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:30.905410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee37bcc-93c3-4034-afc8-0677ae6757cb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:30.947899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26dbad-eeee-4cf3-ab92-48d982db3733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:30.948519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26dbad-eeee-4cf3-ab92-48d982db3733 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:30.948800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26dbad-eeee-4cf3-ab92-48d982db3733 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:30.949072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26dbad-eeee-4cf3-ab92-48d982db3733 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:30.949735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26dbad-eeee-4cf3-ab92-48d982db3733 None admin] RBAC: Adding query filter params (name=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:30.950042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26dbad-eeee-4cf3-ab92-48d982db3733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:30.951442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab26dbad-eeee-4cf3-ab92-48d982db3733 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:30.961743 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 500/1024] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:30.962904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1d586-97e7-4b9b-b064-eca0beda4b45 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:31.069297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1d586-97e7-4b9b-b064-eca0beda4b45 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:31.097379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979f4d-3e57-4bd4-80c6-9aa1143c6e37 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.097670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979f4d-3e57-4bd4-80c6-9aa1143c6e37 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.097947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979f4d-3e57-4bd4-80c6-9aa1143c6e37 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.099352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 501/1025] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:31.104207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efd015-f2be-49a2-82f9-7f97c16b4c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:31.104435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea350d-760e-4ac3-ae94-072fc7f5f5a8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.104711 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea350d-760e-4ac3-ae94-072fc7f5f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.104814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efd015-f2be-49a2-82f9-7f97c16b4c63 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.104983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea350d-760e-4ac3-ae94-072fc7f5f5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.105083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efd015-f2be-49a2-82f9-7f97c16b4c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.105342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efd015-f2be-49a2-82f9-7f97c16b4c63 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.105978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efd015-f2be-49a2-82f9-7f97c16b4c63 None admin] RBAC: Adding query filter params (type=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:31.106315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efd015-f2be-49a2-82f9-7f97c16b4c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:31.107677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efd015-f2be-49a2-82f9-7f97c16b4c63 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:31.117515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 525/1026] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:31.118594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efd015-f2be-49a2-82f9-7f97c16b4c63 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:31.124222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-eaea350d-760e-4ac3-ae94-072fc7f5f5a8 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:31.125484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eaea350d-760e-4ac3-ae94-072fc7f5f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:31.180279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:31.199156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:31.204566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 502/1027] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:31.225212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efd015-f2be-49a2-82f9-7f97c16b4c63 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:31.260361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2fcac-22c9-48c9-adf3-a644259f70d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:31.261048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2fcac-22c9-48c9-adf3-a644259f70d8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.261396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2fcac-22c9-48c9-adf3-a644259f70d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.261732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2fcac-22c9-48c9-adf3-a644259f70d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.262531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2fcac-22c9-48c9-adf3-a644259f70d8 None admin] RBAC: Adding query filter params (interface=public, service_id=ecb760a6a713412b819539a63b347e47, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:31.262908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2fcac-22c9-48c9-adf3-a644259f70d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:31.264337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2fcac-22c9-48c9-adf3-a644259f70d8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:31.269645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 526/1028] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 08:44:31 2022] GET /identity/v3/endpoints?service_id=ecb760a6a713412b819539a63b347e47&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:31.275361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea350d-760e-4ac3-ae94-072fc7f5f5a8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:31.307884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d3374-8497-45cd-81f8-9f4ca418da0d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.308386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d3374-8497-45cd-81f8-9f4ca418da0d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.308509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d3374-8497-45cd-81f8-9f4ca418da0d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.309767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 527/1029] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:31.314634 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4983fe3-6bcf-4559-acf7-3d25e85f1bb1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.314923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4983fe3-6bcf-4559-acf7-3d25e85f1bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.315201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4983fe3-6bcf-4559-acf7-3d25e85f1bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.333384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b4983fe3-6bcf-4559-acf7-3d25e85f1bb1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:31.334647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b4983fe3-6bcf-4559-acf7-3d25e85f1bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:31.378629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea350d-760e-4ac3-ae94-072fc7f5f5a8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:31.416522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a1a5-2008-4d5a-9cb2-cef3d2e5e251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:31.417138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a1a5-2008-4d5a-9cb2-cef3d2e5e251 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.417420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a1a5-2008-4d5a-9cb2-cef3d2e5e251 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.422139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a1a5-2008-4d5a-9cb2-cef3d2e5e251 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.422270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 528/1030] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:31.422372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25a1a5-2008-4d5a-9cb2-cef3d2e5e251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:31.422372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25a1a5-2008-4d5a-9cb2-cef3d2e5e251 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:31.428771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 503/1031] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 08:44:31 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:44:31.476777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4983fe3-6bcf-4559-acf7-3d25e85f1bb1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:31.540190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:31.587768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4983fe3-6bcf-4559-acf7-3d25e85f1bb1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:31.625135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58ea9e-5c4a-4f62-b741-71646033b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:31.625825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58ea9e-5c4a-4f62-b741-71646033b824 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.626314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58ea9e-5c4a-4f62-b741-71646033b824 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.626739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58ea9e-5c4a-4f62-b741-71646033b824 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.627907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58ea9e-5c4a-4f62-b741-71646033b824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:31.629755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58ea9e-5c4a-4f62-b741-71646033b824 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:31.631644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 529/1032] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:31.637602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a1a5-2008-4d5a-9cb2-cef3d2e5e251 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:31.688201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58ea9e-5c4a-4f62-b741-71646033b824 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:31.702621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:31.745903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a1a5-2008-4d5a-9cb2-cef3d2e5e251 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:31.783175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab477a9-762e-4ccb-aca0-0a2e9b59c66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:31.783792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab477a9-762e-4ccb-aca0-0a2e9b59c66a None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.784079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab477a9-762e-4ccb-aca0-0a2e9b59c66a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.784358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab477a9-762e-4ccb-aca0-0a2e9b59c66a None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.785038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab477a9-762e-4ccb-aca0-0a2e9b59c66a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:31.786507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab477a9-762e-4ccb-aca0-0a2e9b59c66a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:31.797561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58ea9e-5c4a-4f62-b741-71646033b824 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:31.824215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:31.835408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea1194-b69d-471c-b587-7173b8cbfeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:31.836038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea1194-b69d-471c-b587-7173b8cbfeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:31.836317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea1194-b69d-471c-b587-7173b8cbfeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:31.836591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea1194-b69d-471c-b587-7173b8cbfeb3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:31.846986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea1194-b69d-471c-b587-7173b8cbfeb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-10ea1194-b69d-471c-b587-7173b8cbfeb3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:31.852880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:31.853877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:31.854753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 530/1033] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 08:44:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:31.859817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea1194-b69d-471c-b587-7173b8cbfeb3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:31.884990 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 504/1034] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:44:31 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:31.972823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea1194-b69d-471c-b587-7173b8cbfeb3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:32.010880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0024787-1e91-4374-89f4-12d8e99a8813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:32.011421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0024787-1e91-4374-89f4-12d8e99a8813 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:32.011705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0024787-1e91-4374-89f4-12d8e99a8813 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:32.011983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0024787-1e91-4374-89f4-12d8e99a8813 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:32.012830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0024787-1e91-4374-89f4-12d8e99a8813 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:32.013144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0024787-1e91-4374-89f4-12d8e99a8813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:32.014582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0024787-1e91-4374-89f4-12d8e99a8813 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:32.023808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 531/1035] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 08:44:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:32.029756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab477a9-762e-4ccb-aca0-0a2e9b59c66a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:32.137201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab477a9-762e-4ccb-aca0-0a2e9b59c66a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:32.158579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:32.173418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491cd0-0d3e-4590-b381-d105eda58763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:32.175865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491cd0-0d3e-4590-b381-d105eda58763 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:32.175865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491cd0-0d3e-4590-b381-d105eda58763 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:32.175865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491cd0-0d3e-4590-b381-d105eda58763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:32.185729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2491cd0-0d3e-4590-b381-d105eda58763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:32.187295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2491cd0-0d3e-4590-b381-d105eda58763 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f2491cd0-0d3e-4590-b381-d105eda58763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:32.202803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:32.204948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:32.205864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:32.205864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:32.205864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:32.205864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 505/1036] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:32.210418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0024787-1e91-4374-89f4-12d8e99a8813 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:32.258976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:32.314587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0024787-1e91-4374-89f4-12d8e99a8813 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:32.350380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57243299-dbef-4dfe-9b17-4d442184848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:32.350992 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57243299-dbef-4dfe-9b17-4d442184848d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:32.351278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57243299-dbef-4dfe-9b17-4d442184848d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:32.351555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57243299-dbef-4dfe-9b17-4d442184848d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:32.352472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57243299-dbef-4dfe-9b17-4d442184848d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:32.352769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57243299-dbef-4dfe-9b17-4d442184848d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:32.354163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57243299-dbef-4dfe-9b17-4d442184848d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:32.366832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 532/1037] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:32.372287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491cd0-0d3e-4590-b381-d105eda58763 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:32.475041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491cd0-0d3e-4590-b381-d105eda58763 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:32.508358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f281e-30b9-4599-8767-5790a974c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:32.508985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f281e-30b9-4599-8767-5790a974c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:32.509266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f281e-30b9-4599-8767-5790a974c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:32.509537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f281e-30b9-4599-8767-5790a974c4a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:32.517031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f281e-30b9-4599-8767-5790a974c4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:32.518499 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f281e-30b9-4599-8767-5790a974c4a9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4f8f281e-30b9-4599-8767-5790a974c4a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:44:32.529451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:32.535604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:32.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 506/1038] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 08:44:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:32.537703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57243299-dbef-4dfe-9b17-4d442184848d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:32.642820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57243299-dbef-4dfe-9b17-4d442184848d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:32.651387 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:32.677794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16707e0e-64ed-4a03-a427-a2f94baf22d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:32.678427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16707e0e-64ed-4a03-a427-a2f94baf22d4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:32.678706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16707e0e-64ed-4a03-a427-a2f94baf22d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:32.678977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16707e0e-64ed-4a03-a427-a2f94baf22d4 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:32.679702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16707e0e-64ed-4a03-a427-a2f94baf22d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:32.680008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16707e0e-64ed-4a03-a427-a2f94baf22d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:32.681422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16707e0e-64ed-4a03-a427-a2f94baf22d4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:32.704056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 533/1039] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 08:44:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:32.705863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f281e-30b9-4599-8767-5790a974c4a9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:32.738597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:32.808428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f281e-30b9-4599-8767-5790a974c4a9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:32.841848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e3c26-d009-4feb-91ca-7956237f5ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:32.842512 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e3c26-d009-4feb-91ca-7956237f5ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:32.842795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e3c26-d009-4feb-91ca-7956237f5ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:32.843067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e3c26-d009-4feb-91ca-7956237f5ba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:32.911093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e3c26-d009-4feb-91ca-7956237f5ba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:32.913023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e3c26-d009-4feb-91ca-7956237f5ba3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:32.946634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:33.015264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 507/1040] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:33.021203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16707e0e-64ed-4a03-a427-a2f94baf22d4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:33.119764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16707e0e-64ed-4a03-a427-a2f94baf22d4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:33.152755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdcb76-0812-4adb-932d-0f27513c6db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:33.153390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdcb76-0812-4adb-932d-0f27513c6db8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:33.153672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdcb76-0812-4adb-932d-0f27513c6db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:33.153947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdcb76-0812-4adb-932d-0f27513c6db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:33.164595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdcb76-0812-4adb-932d-0f27513c6db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:33.165974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdcb76-0812-4adb-932d-0f27513c6db8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-57cdcb76-0812-4adb-932d-0f27513c6db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:33.184277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:33.185417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:33.186618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:33.186618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:33.186618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:33.186618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 534/1041] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:33.191704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e3c26-d009-4feb-91ca-7956237f5ba3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:33.290071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e3c26-d009-4feb-91ca-7956237f5ba3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:33.318684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:33.324000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc073de5-7441-48b0-8958-db2e627687b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:33.324613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073de5-7441-48b0-8958-db2e627687b2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:33.324892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073de5-7441-48b0-8958-db2e627687b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:33.325164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073de5-7441-48b0-8958-db2e627687b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:33.325811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc073de5-7441-48b0-8958-db2e627687b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:33.326139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc073de5-7441-48b0-8958-db2e627687b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:33.327528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc073de5-7441-48b0-8958-db2e627687b2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:33.342280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 508/1042] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:33.345171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdcb76-0812-4adb-932d-0f27513c6db8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:33.364355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:33.447322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdcb76-0812-4adb-932d-0f27513c6db8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:33.481862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578db479-9a3e-4c61-873a-3085ca7f296c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:33.482548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578db479-9a3e-4c61-873a-3085ca7f296c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:33.482835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578db479-9a3e-4c61-873a-3085ca7f296c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:33.483102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578db479-9a3e-4c61-873a-3085ca7f296c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:33.491636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578db479-9a3e-4c61-873a-3085ca7f296c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:33.493134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578db479-9a3e-4c61-873a-3085ca7f296c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-578db479-9a3e-4c61-873a-3085ca7f296c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:33.505708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:33.506751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:33.512663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:33.512663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:33.512663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:33.512663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:33.512663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:33.512663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:33.512663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:33.512663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:33.512663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 535/1043] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:33.514735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc073de5-7441-48b0-8958-db2e627687b2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:33.602713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d34010-2c1c-467f-b108-c950c967b380 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:33.603067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d34010-2c1c-467f-b108-c950c967b380 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:33.603265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d34010-2c1c-467f-b108-c950c967b380 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:33.604597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 536/1044] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:33.609656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce1c0e-0fa1-43bc-b0b5-9f83ff6092a3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:33.609946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce1c0e-0fa1-43bc-b0b5-9f83ff6092a3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:33.610256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce1c0e-0fa1-43bc-b0b5-9f83ff6092a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:33.617551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc073de5-7441-48b0-8958-db2e627687b2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:33.628925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b4ce1c0e-0fa1-43bc-b0b5-9f83ff6092a3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:33.630170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b4ce1c0e-0fa1-43bc-b0b5-9f83ff6092a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:33.652780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486a5b2-7cb1-45e9-a544-3bfa323321f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:33.653391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486a5b2-7cb1-45e9-a544-3bfa323321f6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:33.653670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486a5b2-7cb1-45e9-a544-3bfa323321f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:33.653942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486a5b2-7cb1-45e9-a544-3bfa323321f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:33.655099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486a5b2-7cb1-45e9-a544-3bfa323321f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:33.655407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486a5b2-7cb1-45e9-a544-3bfa323321f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:33.656981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486a5b2-7cb1-45e9-a544-3bfa323321f6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:33.673741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 509/1045] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:33.675020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486a5b2-7cb1-45e9-a544-3bfa323321f6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:33.706774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 537/1046] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:33.736634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:33.785273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486a5b2-7cb1-45e9-a544-3bfa323321f6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:33.820237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610ccfa-e0ca-496d-97ce-a80c45e460d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:33.820842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ccfa-e0ca-496d-97ce-a80c45e460d6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:33.821123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ccfa-e0ca-496d-97ce-a80c45e460d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:33.821394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ccfa-e0ca-496d-97ce-a80c45e460d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:33.822141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ccfa-e0ca-496d-97ce-a80c45e460d6 None admin] RBAC: Adding query filter params (role.id=a3ff1ddfe66c4d2eba431a612b81a285, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=9f31f738fe094e4ea7ed440e661e2111) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:33.822452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ccfa-e0ca-496d-97ce-a80c45e460d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:33.823875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ccfa-e0ca-496d-97ce-a80c45e460d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:33.838414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 510/1047] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:33 2022] GET /identity/v3/role_assignments?user.id=9f31f738fe094e4ea7ed440e661e2111&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a3ff1ddfe66c4d2eba431a612b81a285 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:33.981051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce1c0e-0fa1-43bc-b0b5-9f83ff6092a3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:33.989973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:34.089903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce1c0e-0fa1-43bc-b0b5-9f83ff6092a3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:34.125005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f97b-1594-4d1f-a562-d84fa5a4a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:34.125646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f97b-1594-4d1f-a562-d84fa5a4a107 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:34.125753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ca938-4cbe-46bc-ac76-d0aec70d1df1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:34.125970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ca938-4cbe-46bc-ac76-d0aec70d1df1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:34.126071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f97b-1594-4d1f-a562-d84fa5a4a107 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:34.126281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ca938-4cbe-46bc-ac76-d0aec70d1df1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:34.126394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f97b-1594-4d1f-a562-d84fa5a4a107 None admin] PATH_INFO: `/v3/services/image` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:34.126874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92f97b-1594-4d1f-a562-d84fa5a4a107 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:34.127760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 511/1048] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:34.128309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92f97b-1594-4d1f-a562-d84fa5a4a107 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:34.133108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897899c5-18a9-441b-840f-ed7b90e71d36 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:34.133391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897899c5-18a9-441b-840f-ed7b90e71d36 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:34.133662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897899c5-18a9-441b-840f-ed7b90e71d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ae92f97b-1594-4d1f-a562-d84fa5a4a107 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:34.137913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:34.138907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:34.139749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 538/1049] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Oct 4 08:44:33 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:34.145168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f97b-1594-4d1f-a562-d84fa5a4a107 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:34.155050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-897899c5-18a9-441b-840f-ed7b90e71d36 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:34.156288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-897899c5-18a9-441b-840f-ed7b90e71d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:34.215773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:34.229185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 512/1050] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:34.247462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f97b-1594-4d1f-a562-d84fa5a4a107 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:34.281190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d244-3854-4ef7-a077-182038091ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:34.281802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d244-3854-4ef7-a077-182038091ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:34.282105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d244-3854-4ef7-a077-182038091ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:34.282381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d244-3854-4ef7-a077-182038091ff4 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:34.283009 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1d244-3854-4ef7-a077-182038091ff4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:34.283313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1d244-3854-4ef7-a077-182038091ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:34.284681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1d244-3854-4ef7-a077-182038091ff4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:34.290235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 539/1051] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:34.298103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897899c5-18a9-441b-840f-ed7b90e71d36 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:34.346971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:34.399923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897899c5-18a9-441b-840f-ed7b90e71d36 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:34.432730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6366fba-863b-4130-8dd1-86f3bd96bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:34.433333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6366fba-863b-4130-8dd1-86f3bd96bd2f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:34.433615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6366fba-863b-4130-8dd1-86f3bd96bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:34.433993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6366fba-863b-4130-8dd1-86f3bd96bd2f None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:34.434650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6366fba-863b-4130-8dd1-86f3bd96bd2f None admin] RBAC: Adding query filter params (type=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:34.434952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6366fba-863b-4130-8dd1-86f3bd96bd2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:34.436364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6366fba-863b-4130-8dd1-86f3bd96bd2f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:34.445691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 513/1052] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:34.446681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d244-3854-4ef7-a077-182038091ff4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:34.503292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6366fba-863b-4130-8dd1-86f3bd96bd2f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:34.549983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d244-3854-4ef7-a077-182038091ff4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:34.586473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358f558-9260-4040-8040-9153342f5950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:34.587088 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358f558-9260-4040-8040-9153342f5950 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:34.587374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358f558-9260-4040-8040-9153342f5950 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:34.587652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358f558-9260-4040-8040-9153342f5950 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:34.588352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358f558-9260-4040-8040-9153342f5950 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:34.589744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358f558-9260-4040-8040-9153342f5950 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:34.594653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:34.610196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6366fba-863b-4130-8dd1-86f3bd96bd2f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:34.621153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:34.644009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de6510-1f96-45a1-9bd5-b90c720bc92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:34.644633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de6510-1f96-45a1-9bd5-b90c720bc92f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:34.644910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de6510-1f96-45a1-9bd5-b90c720bc92f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:34.645198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de6510-1f96-45a1-9bd5-b90c720bc92f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:34.655356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de6510-1f96-45a1-9bd5-b90c720bc92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f7de6510-1f96-45a1-9bd5-b90c720bc92f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:34.660123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:34.666469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 514/1053] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:34.667296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de6510-1f96-45a1-9bd5-b90c720bc92f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:34.694175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 540/1054] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:44:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:34.778337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de6510-1f96-45a1-9bd5-b90c720bc92f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:34.822222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb2b0-c4dd-4af5-92fc-9893ae639b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:34.823190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb2b0-c4dd-4af5-92fc-9893ae639b47 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:34.823663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb2b0-c4dd-4af5-92fc-9893ae639b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:34.824119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb2b0-c4dd-4af5-92fc-9893ae639b47 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:34.824971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb2b0-c4dd-4af5-92fc-9893ae639b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:34.825500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb2b0-c4dd-4af5-92fc-9893ae639b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:34.827202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb2b0-c4dd-4af5-92fc-9893ae639b47 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:34.842190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 515/1055] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:34.843576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358f558-9260-4040-8040-9153342f5950 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:34.949856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358f558-9260-4040-8040-9153342f5950 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:34.983358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f900c7-6fbe-43e2-a27e-ec3ac2ee2b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:34.983990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f900c7-6fbe-43e2-a27e-ec3ac2ee2b42 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:34.984269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f900c7-6fbe-43e2-a27e-ec3ac2ee2b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:34.984540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f900c7-6fbe-43e2-a27e-ec3ac2ee2b42 None admin] PATH_INFO: `/v3/users/f40f23c6d9a5444bb4335fe580d03871` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:34.998072 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f900c7-6fbe-43e2-a27e-ec3ac2ee2b42 None admin] RBAC: Authorizing `identity:get_user(user_id=f40f23c6d9a5444bb4335fe580d03871)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:34.999548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f900c7-6fbe-43e2-a27e-ec3ac2ee2b42 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:35.001319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 541/1056] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:44:34 2022] GET /identity/v3/users/f40f23c6d9a5444bb4335fe580d03871 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:35.007356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb2b0-c4dd-4af5-92fc-9893ae639b47 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:35.035797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:35.106810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb2b0-c4dd-4af5-92fc-9893ae639b47 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:35.140331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca00833-d061-45dd-97be-9c8431c616b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:35.140938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca00833-d061-45dd-97be-9c8431c616b8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:35.141218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca00833-d061-45dd-97be-9c8431c616b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:35.141486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca00833-d061-45dd-97be-9c8431c616b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:35.208385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca00833-d061-45dd-97be-9c8431c616b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:35.209855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca00833-d061-45dd-97be-9c8431c616b8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:35.235702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:35.307464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 516/1057] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:35.312986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f900c7-6fbe-43e2-a27e-ec3ac2ee2b42 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:35.361655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:35.413053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f900c7-6fbe-43e2-a27e-ec3ac2ee2b42 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:35.447355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ab159-3c63-4ca3-a0ee-50f15cac9007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:35.447988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ab159-3c63-4ca3-a0ee-50f15cac9007 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:35.448244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ab159-3c63-4ca3-a0ee-50f15cac9007 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:35.448515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ab159-3c63-4ca3-a0ee-50f15cac9007 None admin] PATH_INFO: `/v3/projects/f6a4068345834673884e6473f8e5e058` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:35.449625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ab159-3c63-4ca3-a0ee-50f15cac9007 None admin] RBAC: Authorizing `identity:get_project(project_id=f6a4068345834673884e6473f8e5e058)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:35.451144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ab159-3c63-4ca3-a0ee-50f15cac9007 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:35.452982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 542/1058] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:44:35 2022] GET /identity/v3/projects/f6a4068345834673884e6473f8e5e058 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:35.458872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca00833-d061-45dd-97be-9c8431c616b8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:35.556360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca00833-d061-45dd-97be-9c8431c616b8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:35.581533 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:35.589645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc07976-7a5f-4490-b1ce-5c1fd550481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:35.590361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc07976-7a5f-4490-b1ce-5c1fd550481e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:35.590626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc07976-7a5f-4490-b1ce-5c1fd550481e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:35.590875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc07976-7a5f-4490-b1ce-5c1fd550481e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:35.591610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc07976-7a5f-4490-b1ce-5c1fd550481e None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=f6a4068345834673884e6473f8e5e058, user.id=f40f23c6d9a5444bb4335fe580d03871) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:35.591915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc07976-7a5f-4490-b1ce-5c1fd550481e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:35.593383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc07976-7a5f-4490-b1ce-5c1fd550481e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:35.600191 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 517/1059] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:35 2022] GET /identity/v3/role_assignments?user.id=f40f23c6d9a5444bb4335fe580d03871&scope.project.id=f6a4068345834673884e6473f8e5e058&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:35.966029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c179dc-0ea8-434a-aec7-cd48a9fbec6b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:35.966375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c179dc-0ea8-434a-aec7-cd48a9fbec6b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:35.966624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c179dc-0ea8-434a-aec7-cd48a9fbec6b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:35.968153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 543/1060] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:35.972997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854a92-9434-48d5-a9bb-119c2161cfa2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:35.973435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854a92-9434-48d5-a9bb-119c2161cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:35.973599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854a92-9434-48d5-a9bb-119c2161cfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:35.992381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-45854a92-9434-48d5-a9bb-119c2161cfa2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:35.993585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-45854a92-9434-48d5-a9bb-119c2161cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:36.060858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 518/1061] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:36.330296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c179dc-0ea8-434a-aec7-cd48a9fbec6b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:36.431730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c179dc-0ea8-434a-aec7-cd48a9fbec6b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:36.451107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:36.470340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a686fe-6048-4832-93e1-9e7d928d035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:36.471030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a686fe-6048-4832-93e1-9e7d928d035b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:36.471314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a686fe-6048-4832-93e1-9e7d928d035b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:36.471613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a686fe-6048-4832-93e1-9e7d928d035b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:36.481918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a686fe-6048-4832-93e1-9e7d928d035b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b2a686fe-6048-4832-93e1-9e7d928d035b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:36.486845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:36.487773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:36.488649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:36.496503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 544/1062] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 08:44:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:36.496628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854a92-9434-48d5-a9bb-119c2161cfa2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:36.592798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854a92-9434-48d5-a9bb-119c2161cfa2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:36.615760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:36.627399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bad8cd-79dd-4c37-b3bf-d20b16cb50cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:36.628005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bad8cd-79dd-4c37-b3bf-d20b16cb50cd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:36.628284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bad8cd-79dd-4c37-b3bf-d20b16cb50cd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:36.628558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bad8cd-79dd-4c37-b3bf-d20b16cb50cd None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:36.629217 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bad8cd-79dd-4c37-b3bf-d20b16cb50cd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:36.629517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bad8cd-79dd-4c37-b3bf-d20b16cb50cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:36.631694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bad8cd-79dd-4c37-b3bf-d20b16cb50cd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:36.644298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 519/1063] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 08:44:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:36.645158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a686fe-6048-4832-93e1-9e7d928d035b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:36.744638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a686fe-6048-4832-93e1-9e7d928d035b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:36.785514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0979191-c10b-455b-a0d0-30183d85a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:36.786591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979191-c10b-455b-a0d0-30183d85a01c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:36.786873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979191-c10b-455b-a0d0-30183d85a01c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:36.787196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0979191-c10b-455b-a0d0-30183d85a01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:36.799018 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0979191-c10b-455b-a0d0-30183d85a01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:36.800479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0979191-c10b-455b-a0d0-30183d85a01c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a0979191-c10b-455b-a0d0-30183d85a01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:36.816477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:36.822650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:36.823549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:36.823549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:36.823549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:36.823549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 545/1064] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:36.826257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bad8cd-79dd-4c37-b3bf-d20b16cb50cd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:36.883761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9538ce5-00ca-4e45-a819-eb955400ab79 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:36.884106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9538ce5-00ca-4e45-a819-eb955400ab79 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:36.884345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9538ce5-00ca-4e45-a819-eb955400ab79 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:36.886121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 546/1065] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:36.890652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33babe1-7478-4155-843e-a4fd533a96f1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:36.890933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33babe1-7478-4155-843e-a4fd533a96f1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:36.891210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33babe1-7478-4155-843e-a4fd533a96f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:36.910281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b33babe1-7478-4155-843e-a4fd533a96f1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:36.911466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b33babe1-7478-4155-843e-a4fd533a96f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:36.939287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bad8cd-79dd-4c37-b3bf-d20b16cb50cd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:36.942215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:36.974907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd549f0-de29-4d28-b960-97b58a1c36ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:36.975521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd549f0-de29-4d28-b960-97b58a1c36ac None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:36.975804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd549f0-de29-4d28-b960-97b58a1c36ac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:36.976081 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd549f0-de29-4d28-b960-97b58a1c36ac None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:36.976737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd549f0-de29-4d28-b960-97b58a1c36ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:36.977300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd549f0-de29-4d28-b960-97b58a1c36ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:36.978706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd549f0-de29-4d28-b960-97b58a1c36ac None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:36.994228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 520/1066] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:36.996368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd549f0-de29-4d28-b960-97b58a1c36ac None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:37.002130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 547/1067] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:37.043538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:37.097026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd549f0-de29-4d28-b960-97b58a1c36ac None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:37.131215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9162e-50c6-4ac5-ae28-4284682b28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:37.131842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9162e-50c6-4ac5-ae28-4284682b28eb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.132121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9162e-50c6-4ac5-ae28-4284682b28eb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.132393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9162e-50c6-4ac5-ae28-4284682b28eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.139366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9162e-50c6-4ac5-ae28-4284682b28eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:37.140739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9162e-50c6-4ac5-ae28-4284682b28eb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0bd9162e-50c6-4ac5-ae28-4284682b28eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:44:37.153615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:37.154635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:37.160283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 521/1068] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 08:44:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:37.160880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33babe1-7478-4155-843e-a4fd533a96f1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:37.267390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33babe1-7478-4155-843e-a4fd533a96f1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:37.273156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9162e-50c6-4ac5-ae28-4284682b28eb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:37.303474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2b3ca-805d-430a-b245-9110a8e763e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:37.304107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2b3ca-805d-430a-b245-9110a8e763e3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.304366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2b3ca-805d-430a-b245-9110a8e763e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.304702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2b3ca-805d-430a-b245-9110a8e763e3 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.305431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2b3ca-805d-430a-b245-9110a8e763e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:37.305736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2b3ca-805d-430a-b245-9110a8e763e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:37.307213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2b3ca-805d-430a-b245-9110a8e763e3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:37.328791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 548/1069] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 08:44:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:37.335205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2b3ca-805d-430a-b245-9110a8e763e3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:37.354746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:37.379223 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9162e-50c6-4ac5-ae28-4284682b28eb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:37.382544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:37.414660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4f496-dead-4f75-89e3-2062eff2ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:37.415206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f496-dead-4f75-89e3-2062eff2ae31 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.415485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f496-dead-4f75-89e3-2062eff2ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.415759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f496-dead-4f75-89e3-2062eff2ae31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.439122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2b3ca-805d-430a-b245-9110a8e763e3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:37.477782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dabe7f-80a6-4002-b875-e8c40d51605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:37.479118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dabe7f-80a6-4002-b875-e8c40d51605b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.479543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dabe7f-80a6-4002-b875-e8c40d51605b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.479986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dabe7f-80a6-4002-b875-e8c40d51605b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.487346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4f496-dead-4f75-89e3-2062eff2ae31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:37.489213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4f496-dead-4f75-89e3-2062eff2ae31 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:37.489856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dabe7f-80a6-4002-b875-e8c40d51605b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:37.491311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dabe7f-80a6-4002-b875-e8c40d51605b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-74dabe7f-80a6-4002-b875-e8c40d51605b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:37.508256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:37.509262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:37.515487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:37.515487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:37.515487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:37.515487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 549/1070] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:37.515487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dabe7f-80a6-4002-b875-e8c40d51605b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:37.582116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:37.610188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 522/1071] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:44:37.615964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4f496-dead-4f75-89e3-2062eff2ae31 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:37.620726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:37.625658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dabe7f-80a6-4002-b875-e8c40d51605b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:37.662540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728b8ca-9cf2-4ae1-9fc7-30f5c54a79af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:37.663506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b8ca-9cf2-4ae1-9fc7-30f5c54a79af None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.663800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b8ca-9cf2-4ae1-9fc7-30f5c54a79af None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.664080 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728b8ca-9cf2-4ae1-9fc7-30f5c54a79af None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.665109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728b8ca-9cf2-4ae1-9fc7-30f5c54a79af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:37.665600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728b8ca-9cf2-4ae1-9fc7-30f5c54a79af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:37.666932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728b8ca-9cf2-4ae1-9fc7-30f5c54a79af None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:37.684544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 550/1072] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:37.685810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728b8ca-9cf2-4ae1-9fc7-30f5c54a79af None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:37.726842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4f496-dead-4f75-89e3-2062eff2ae31 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:37.760964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b817f65-f239-4b06-bdd0-f768eaca1605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:37.761584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b817f65-f239-4b06-bdd0-f768eaca1605 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.761869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b817f65-f239-4b06-bdd0-f768eaca1605 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.762163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b817f65-f239-4b06-bdd0-f768eaca1605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.772225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b817f65-f239-4b06-bdd0-f768eaca1605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:37.773878 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b817f65-f239-4b06-bdd0-f768eaca1605 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:37.782723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728b8ca-9cf2-4ae1-9fc7-30f5c54a79af None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8b817f65-f239-4b06-bdd0-f768eaca1605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:37.789055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:37.790050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:37.790987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:37.790987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:37.790987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:37.790987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 523/1073] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:37.791381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465f659-4d42-466e-a1a6-252175eb03db None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.791666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465f659-4d42-466e-a1a6-252175eb03db None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.791943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465f659-4d42-466e-a1a6-252175eb03db None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.793450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 524/1074] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:37.796170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465f659-4d42-466e-a1a6-252175eb03db None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:37.812919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:37.821279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ff93d-d7d0-4f36-9a9e-5dab883746b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:37.822105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff93d-d7d0-4f36-9a9e-5dab883746b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.822405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff93d-d7d0-4f36-9a9e-5dab883746b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.822676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff93d-d7d0-4f36-9a9e-5dab883746b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.829156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ff93d-d7d0-4f36-9a9e-5dab883746b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:37.830670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ff93d-d7d0-4f36-9a9e-5dab883746b7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6a0ff93d-d7d0-4f36-9a9e-5dab883746b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:37.842669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:37.843573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:37.844550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:37.844550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:37.844550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:37.844550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:37.844550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:37.844550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:37.844550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:37.844550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:37.844550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 551/1075] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:37.845039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cdc99-ff55-4407-97ef-3dc163ec3a5d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.845301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cdc99-ff55-4407-97ef-3dc163ec3a5d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.845564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cdc99-ff55-4407-97ef-3dc163ec3a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.858203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:37.866280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fc2cdc99-ff55-4407-97ef-3dc163ec3a5d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:37.867482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc2cdc99-ff55-4407-97ef-3dc163ec3a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:37.902739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465f659-4d42-466e-a1a6-252175eb03db None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:37.934548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 552/1076] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:37.935340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cdc99-ff55-4407-97ef-3dc163ec3a5d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:37.948447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecf9e3-15cb-4c6e-80ad-c50a048bca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:37.949065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf9e3-15cb-4c6e-80ad-c50a048bca9d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:37.949344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf9e3-15cb-4c6e-80ad-c50a048bca9d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:37.949637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecf9e3-15cb-4c6e-80ad-c50a048bca9d None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:37.950327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf9e3-15cb-4c6e-80ad-c50a048bca9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:37.950618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf9e3-15cb-4c6e-80ad-c50a048bca9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:37.951987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecf9e3-15cb-4c6e-80ad-c50a048bca9d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:37.964901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 525/1077] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:38.048078 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cdc99-ff55-4407-97ef-3dc163ec3a5d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:38.066665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:38.085300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ddc5b-999b-4463-a2a1-630f5cd5e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:38.085931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ddc5b-999b-4463-a2a1-630f5cd5e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:38.086241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ddc5b-999b-4463-a2a1-630f5cd5e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:38.086518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ddc5b-999b-4463-a2a1-630f5cd5e2d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:38.087222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ddc5b-999b-4463-a2a1-630f5cd5e2d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:38.087530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ddc5b-999b-4463-a2a1-630f5cd5e2d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:38.089106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ddc5b-999b-4463-a2a1-630f5cd5e2d0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:38.108220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 553/1078] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:38.109890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecf9e3-15cb-4c6e-80ad-c50a048bca9d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:38.207821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ddc5b-999b-4463-a2a1-630f5cd5e2d0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:38.216825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecf9e3-15cb-4c6e-80ad-c50a048bca9d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:38.236224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:38.254457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e62bc-3534-4568-8053-ebb4a42f465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:38.255150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e62bc-3534-4568-8053-ebb4a42f465f None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:38.255430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e62bc-3534-4568-8053-ebb4a42f465f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:38.261509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e62bc-3534-4568-8053-ebb4a42f465f None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/9f31f738fe094e4ea7ed440e661e2111/roles/a3ff1ddfe66c4d2eba431a612b81a285` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:38.261509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e62bc-3534-4568-8053-ebb4a42f465f None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=9f31f738fe094e4ea7ed440e661e2111, role_id=a3ff1ddfe66c4d2eba431a612b81a285)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:38.261509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e62bc-3534-4568-8053-ebb4a42f465f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:38.318486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ddc5b-999b-4463-a2a1-630f5cd5e2d0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:38.341213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 526/1079] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:44:38 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/9f31f738fe094e4ea7ed440e661e2111/roles/a3ff1ddfe66c4d2eba431a612b81a285 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:44:38.353100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2159a-419f-42a0-895a-94e1f502581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:38.353760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2159a-419f-42a0-895a-94e1f502581f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:38.354042 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2159a-419f-42a0-895a-94e1f502581f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:38.354348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2159a-419f-42a0-895a-94e1f502581f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:38.367019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2159a-419f-42a0-895a-94e1f502581f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1dd2159a-419f-42a0-895a-94e1f502581f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:38.372044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:38.373262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:38.379839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 554/1080] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:38.381034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e62bc-3534-4568-8053-ebb4a42f465f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:38.485061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e62bc-3534-4568-8053-ebb4a42f465f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:38.520531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4ae5a-5a0d-471e-a732-3833c8a2c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:38.521683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4ae5a-5a0d-471e-a732-3833c8a2c253 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:38.521963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4ae5a-5a0d-471e-a732-3833c8a2c253 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:38.522267 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4ae5a-5a0d-471e-a732-3833c8a2c253 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:38.522942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4ae5a-5a0d-471e-a732-3833c8a2c253 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:38.523248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4ae5a-5a0d-471e-a732-3833c8a2c253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:38.524615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4ae5a-5a0d-471e-a732-3833c8a2c253 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:38.532686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 527/1081] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:44:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:38.539293 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2159a-419f-42a0-895a-94e1f502581f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:38.578840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:38.638682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2159a-419f-42a0-895a-94e1f502581f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:38.672040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed4ccd-bbbf-4178-b479-e01bd9d85fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:38.672664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed4ccd-bbbf-4178-b479-e01bd9d85fdc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:38.672940 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed4ccd-bbbf-4178-b479-e01bd9d85fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:38.673211 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed4ccd-bbbf-4178-b479-e01bd9d85fdc None admin] PATH_INFO: `/v3/users/f40f23c6d9a5444bb4335fe580d03871` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:38.674471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed4ccd-bbbf-4178-b479-e01bd9d85fdc None admin] RBAC: Authorizing `identity:get_user(user_id=f40f23c6d9a5444bb4335fe580d03871)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:38.675999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed4ccd-bbbf-4178-b479-e01bd9d85fdc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:38.678154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 555/1082] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:44:38 2022] GET /identity/v3/users/f40f23c6d9a5444bb4335fe580d03871 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:38.683958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4ae5a-5a0d-471e-a732-3833c8a2c253 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:38.722234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:38.780075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4ae5a-5a0d-471e-a732-3833c8a2c253 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:38.814040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327df087-2b41-4703-8f4a-21bd9ccca924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:38.814699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327df087-2b41-4703-8f4a-21bd9ccca924 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:38.814980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327df087-2b41-4703-8f4a-21bd9ccca924 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:38.815253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327df087-2b41-4703-8f4a-21bd9ccca924 None admin] PATH_INFO: `/v3/projects/f6a4068345834673884e6473f8e5e058` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:38.816370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327df087-2b41-4703-8f4a-21bd9ccca924 None admin] RBAC: Authorizing `identity:get_project(project_id=f6a4068345834673884e6473f8e5e058)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:38.817846 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327df087-2b41-4703-8f4a-21bd9ccca924 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:38.819524 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 528/1083] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:44:38 2022] GET /identity/v3/projects/f6a4068345834673884e6473f8e5e058 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:38.825720 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed4ccd-bbbf-4178-b479-e01bd9d85fdc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:38.923313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed4ccd-bbbf-4178-b479-e01bd9d85fdc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:38.930733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:38.959925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e35d81-a09d-44ef-86bf-58c528eb9edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:38.960574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e35d81-a09d-44ef-86bf-58c528eb9edb None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:38.960851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e35d81-a09d-44ef-86bf-58c528eb9edb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:38.961123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e35d81-a09d-44ef-86bf-58c528eb9edb None admin] PATH_INFO: `/v3/projects/f6a4068345834673884e6473f8e5e058/users/f40f23c6d9a5444bb4335fe580d03871/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:38.963030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e35d81-a09d-44ef-86bf-58c528eb9edb None admin] RBAC: Authorizing `identity:create_grant(project_id=f6a4068345834673884e6473f8e5e058, user_id=f40f23c6d9a5444bb4335fe580d03871, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:38.964448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e35d81-a09d-44ef-86bf-58c528eb9edb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:39.036175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 556/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:44:38 2022] PUT /identity/v3/projects/f6a4068345834673884e6473f8e5e058/users/f40f23c6d9a5444bb4335fe580d03871/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:44:40.469152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08b58-1fa3-49b0-bc07-b516350f51b6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:40.469783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08b58-1fa3-49b0-bc07-b516350f51b6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:40.469783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08b58-1fa3-49b0-bc07-b516350f51b6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:40.471089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 529/1085] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:40.477387 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd64f78-211b-4f17-a550-9a7c95510e11 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:40.477786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd64f78-211b-4f17-a550-9a7c95510e11 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:40.478064 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd64f78-211b-4f17-a550-9a7c95510e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:40.495965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9bd64f78-211b-4f17-a550-9a7c95510e11 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:40.497152 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9bd64f78-211b-4f17-a550-9a7c95510e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:40.561564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 557/1086] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:40.834183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb08b58-1fa3-49b0-bc07-b516350f51b6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:40.933114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb08b58-1fa3-49b0-bc07-b516350f51b6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:40.940723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:40.967513 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238860f1-77d6-4f63-b532-98ba31f8e831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:40.968246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238860f1-77d6-4f63-b532-98ba31f8e831 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:40.968529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238860f1-77d6-4f63-b532-98ba31f8e831 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:40.968803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238860f1-77d6-4f63-b532-98ba31f8e831 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:40.978807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238860f1-77d6-4f63-b532-98ba31f8e831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-238860f1-77d6-4f63-b532-98ba31f8e831 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:40.983592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:40.984766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:40.985684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 530/1087] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Oct 4 08:44:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:40.991171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd64f78-211b-4f17-a550-9a7c95510e11 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.085028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:41.090934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd64f78-211b-4f17-a550-9a7c95510e11 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:41.124631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b42a46-4a18-4354-b617-f11238b92a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:41.125239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b42a46-4a18-4354-b617-f11238b92a97 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.125521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b42a46-4a18-4354-b617-f11238b92a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.125794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b42a46-4a18-4354-b617-f11238b92a97 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.126494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b42a46-4a18-4354-b617-f11238b92a97 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:41.126801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b42a46-4a18-4354-b617-f11238b92a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:41.128192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b42a46-4a18-4354-b617-f11238b92a97 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:41.136707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 558/1088] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 08:44:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:41.142540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238860f1-77d6-4f63-b532-98ba31f8e831 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.156228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab65ae-fcd4-4d1e-94a4-0b7ecde1b551 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.156517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab65ae-fcd4-4d1e-94a4-0b7ecde1b551 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.156796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab65ae-fcd4-4d1e-94a4-0b7ecde1b551 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.158170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 559/1089] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:41.163196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18d015-8994-43bd-9f04-5a1999c113b9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.163485 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18d015-8994-43bd-9f04-5a1999c113b9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.163761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18d015-8994-43bd-9f04-5a1999c113b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.181566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0a18d015-8994-43bd-9f04-5a1999c113b9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:41.182786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0a18d015-8994-43bd-9f04-5a1999c113b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:41.242899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238860f1-77d6-4f63-b532-98ba31f8e831 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:41.248588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 560/1090] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:41.275426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6791e26-2053-44db-9188-0259b80fdee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:41.276053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6791e26-2053-44db-9188-0259b80fdee0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.276335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6791e26-2053-44db-9188-0259b80fdee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.276612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6791e26-2053-44db-9188-0259b80fdee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.287445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6791e26-2053-44db-9188-0259b80fdee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:41.288893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6791e26-2053-44db-9188-0259b80fdee0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c6791e26-2053-44db-9188-0259b80fdee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:41.303101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:41.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:41.305079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:41.305079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:41.305079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:41.305079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 531/1091] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:41.309873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18d015-8994-43bd-9f04-5a1999c113b9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.396604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:41.408183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18d015-8994-43bd-9f04-5a1999c113b9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:41.442165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dc20d-d89b-4243-ae8c-b2f63af1eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:41.442766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dc20d-d89b-4243-ae8c-b2f63af1eaaa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.443048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dc20d-d89b-4243-ae8c-b2f63af1eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.443321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dc20d-d89b-4243-ae8c-b2f63af1eaaa None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.443961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dc20d-d89b-4243-ae8c-b2f63af1eaaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:41.444265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dc20d-d89b-4243-ae8c-b2f63af1eaaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:41.445627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dc20d-d89b-4243-ae8c-b2f63af1eaaa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:41.456389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 561/1092] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:41.462003 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6791e26-2053-44db-9188-0259b80fdee0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.481604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:41.514902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dc20d-d89b-4243-ae8c-b2f63af1eaaa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.560468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6791e26-2053-44db-9188-0259b80fdee0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:41.592756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b5f9-32c5-4d64-97e5-d06e4bc06cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:41.593379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b5f9-32c5-4d64-97e5-d06e4bc06cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.593659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b5f9-32c5-4d64-97e5-d06e4bc06cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.593928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b5f9-32c5-4d64-97e5-d06e4bc06cb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.601199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68b5f9-32c5-4d64-97e5-d06e4bc06cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:41.602928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68b5f9-32c5-4d64-97e5-d06e4bc06cb5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:41.613059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dc20d-d89b-4243-ae8c-b2f63af1eaaa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3c68b5f9-32c5-4d64-97e5-d06e4bc06cb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:44:41.615000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:41.616160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:41.617311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 532/1093] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Oct 4 08:44:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:41.621727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b5f9-32c5-4d64-97e5-d06e4bc06cb5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.649625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd7e2-d083-48ec-a29c-2251cd908bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:41.650212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd7e2-d083-48ec-a29c-2251cd908bef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.650492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd7e2-d083-48ec-a29c-2251cd908bef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.650766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd7e2-d083-48ec-a29c-2251cd908bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.662310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbd7e2-d083-48ec-a29c-2251cd908bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0adbd7e2-d083-48ec-a29c-2251cd908bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:44:41.667058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:41.668198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:44:41.669251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 562/1094] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:44:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:41.673947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd7e2-d083-48ec-a29c-2251cd908bef None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.685040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:41.701510 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:41.722451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b5f9-32c5-4d64-97e5-d06e4bc06cb5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:41.756873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564018-78cf-47af-8bb9-a4b38ecd13fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:41.757476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564018-78cf-47af-8bb9-a4b38ecd13fb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.757789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564018-78cf-47af-8bb9-a4b38ecd13fb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.758058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564018-78cf-47af-8bb9-a4b38ecd13fb None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.758818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24564018-78cf-47af-8bb9-a4b38ecd13fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:41.759118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24564018-78cf-47af-8bb9-a4b38ecd13fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:41.760535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24564018-78cf-47af-8bb9-a4b38ecd13fb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:41.773958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd7e2-d083-48ec-a29c-2251cd908bef None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:41.778279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 533/1095] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Oct 4 08:44:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:41.783194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564018-78cf-47af-8bb9-a4b38ecd13fb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.808431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f514705-4071-41a7-8a63-166ac187747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:41.809043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f514705-4071-41a7-8a63-166ac187747c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.809327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f514705-4071-41a7-8a63-166ac187747c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.809604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f514705-4071-41a7-8a63-166ac187747c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.810310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f514705-4071-41a7-8a63-166ac187747c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:41.810614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f514705-4071-41a7-8a63-166ac187747c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:41.811993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f514705-4071-41a7-8a63-166ac187747c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:41.820413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 563/1096] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:44:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:41.826243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f514705-4071-41a7-8a63-166ac187747c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.880632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564018-78cf-47af-8bb9-a4b38ecd13fb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:41.894838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:41.916279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0c577-3ef4-4776-b937-9ccc57b063cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:41.916812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0c577-3ef4-4776-b937-9ccc57b063cd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.917092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0c577-3ef4-4776-b937-9ccc57b063cd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.917357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0c577-3ef4-4776-b937-9ccc57b063cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.920652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:41.925266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f514705-4071-41a7-8a63-166ac187747c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:41.960204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80221d3b-f799-4d28-b193-4b756f688b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:41.960829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80221d3b-f799-4d28-b193-4b756f688b81 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.961108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80221d3b-f799-4d28-b193-4b756f688b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.961383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80221d3b-f799-4d28-b193-4b756f688b81 None admin] PATH_INFO: `/v3/users/f40f23c6d9a5444bb4335fe580d03871` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.962615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80221d3b-f799-4d28-b193-4b756f688b81 None admin] RBAC: Authorizing `identity:get_user(user_id=f40f23c6d9a5444bb4335fe580d03871)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:41.964053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80221d3b-f799-4d28-b193-4b756f688b81 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:41.965956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 564/1097] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:44:41 2022] GET /identity/v3/users/f40f23c6d9a5444bb4335fe580d03871 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:41.971246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80221d3b-f799-4d28-b193-4b756f688b81 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:41.984498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0c577-3ef4-4776-b937-9ccc57b063cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:41.985983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0c577-3ef4-4776-b937-9ccc57b063cd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.068298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80221d3b-f799-4d28-b193-4b756f688b81 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.083116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 534/1098] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:44:42.088785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0c577-3ef4-4776-b937-9ccc57b063cd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:42.101360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b87e1-efba-4850-8dd5-aa930a1c0c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.102271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b87e1-efba-4850-8dd5-aa930a1c0c4b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.102584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b87e1-efba-4850-8dd5-aa930a1c0c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.103119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b87e1-efba-4850-8dd5-aa930a1c0c4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.111241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.121797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.169256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b87e1-efba-4850-8dd5-aa930a1c0c4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.170789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b87e1-efba-4850-8dd5-aa930a1c0c4b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.184748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0c577-3ef4-4776-b937-9ccc57b063cd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.217184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ef66b-d162-4861-93df-ad24277ac7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.217804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef66b-d162-4861-93df-ad24277ac7fd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.218130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef66b-d162-4861-93df-ad24277ac7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.218391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ef66b-d162-4861-93df-ad24277ac7fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.228903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ef66b-d162-4861-93df-ad24277ac7fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.230361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ef66b-d162-4861-93df-ad24277ac7fd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-503ef66b-d162-4861-93df-ad24277ac7fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:44:42.244933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:42.246019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:44:42.247066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:44:42.247066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:44:42.247066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:42.247066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 535/1099] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:44:42.251653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ef66b-d162-4861-93df-ad24277ac7fd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:42.270893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 565/1100] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:44:42.271880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b87e1-efba-4850-8dd5-aa930a1c0c4b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:42.309780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.335983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.347769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ef66b-d162-4861-93df-ad24277ac7fd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.367879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b87e1-efba-4850-8dd5-aa930a1c0c4b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.383242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711305d-56fc-4a7f-8f8b-3d08a1bde925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.383851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711305d-56fc-4a7f-8f8b-3d08a1bde925 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.384134 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711305d-56fc-4a7f-8f8b-3d08a1bde925 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.384407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711305d-56fc-4a7f-8f8b-3d08a1bde925 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.385050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711305d-56fc-4a7f-8f8b-3d08a1bde925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:42.385353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711305d-56fc-4a7f-8f8b-3d08a1bde925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.386737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711305d-56fc-4a7f-8f8b-3d08a1bde925 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.398366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 536/1101] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:42.400714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1109b0-e275-4c43-9070-bba6440b1a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.401332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1109b0-e275-4c43-9070-bba6440b1a60 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.401611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1109b0-e275-4c43-9070-bba6440b1a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.401882 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1109b0-e275-4c43-9070-bba6440b1a60 None admin] PATH_INFO: `/v3/projects/f6a4068345834673884e6473f8e5e058` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.403017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1109b0-e275-4c43-9070-bba6440b1a60 None admin] RBAC: Authorizing `identity:get_project(project_id=f6a4068345834673884e6473f8e5e058)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.403920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711305d-56fc-4a7f-8f8b-3d08a1bde925 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:42.404439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1109b0-e275-4c43-9070-bba6440b1a60 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.406165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 566/1102] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:44:42 2022] GET /identity/v3/projects/f6a4068345834673884e6473f8e5e058 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:42.412529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1109b0-e275-4c43-9070-bba6440b1a60 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:42.505747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711305d-56fc-4a7f-8f8b-3d08a1bde925 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.507015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1109b0-e275-4c43-9070-bba6440b1a60 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.514200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.539022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f080c-4f2f-4050-ba44-f42e0cb3b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.539642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f080c-4f2f-4050-ba44-f42e0cb3b137 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.539920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f080c-4f2f-4050-ba44-f42e0cb3b137 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.540189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f080c-4f2f-4050-ba44-f42e0cb3b137 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.540926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca3b40-7660-4a34-8175-daf2b707140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.541513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3b40-7660-4a34-8175-daf2b707140d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.541899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3b40-7660-4a34-8175-daf2b707140d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.542053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3b40-7660-4a34-8175-daf2b707140d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.542822 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca3b40-7660-4a34-8175-daf2b707140d None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=f6a4068345834673884e6473f8e5e058, user.id=f40f23c6d9a5444bb4335fe580d03871) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:42.543123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca3b40-7660-4a34-8175-daf2b707140d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.544520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca3b40-7660-4a34-8175-daf2b707140d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.546572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f080c-4f2f-4050-ba44-f42e0cb3b137 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.547979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f080c-4f2f-4050-ba44-f42e0cb3b137 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.550076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 567/1103] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:42 2022] GET /identity/v3/role_assignments?user.id=f40f23c6d9a5444bb4335fe580d03871&scope.project.id=f6a4068345834673884e6473f8e5e058&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6f4f080c-4f2f-4050-ba44-f42e0cb3b137 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:44:42.559248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:44:42.560445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:44:42.561345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:44:42.561345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:44:42.561345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:44:42.561345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:44:42.561345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:44:42.561345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:44:42.561345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:44:42.561345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:44:42.561345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 537/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:44:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:44:42.566695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca3b40-7660-4a34-8175-daf2b707140d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:42.671930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca3b40-7660-4a34-8175-daf2b707140d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.706400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7d993-a65c-42b4-8807-6d08cb16145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.707015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d993-a65c-42b4-8807-6d08cb16145f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.707296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d993-a65c-42b4-8807-6d08cb16145f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.707568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d993-a65c-42b4-8807-6d08cb16145f None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.708820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7d993-a65c-42b4-8807-6d08cb16145f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:42.709134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7d993-a65c-42b4-8807-6d08cb16145f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.710610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7d993-a65c-42b4-8807-6d08cb16145f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.723066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 568/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:42.729931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f080c-4f2f-4050-ba44-f42e0cb3b137 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:42.741120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.864304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f080c-4f2f-4050-ba44-f42e0cb3b137 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.897053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18da760-6c64-447d-b140-dc8e11e6aa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.897657 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18da760-6c64-447d-b140-dc8e11e6aa22 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.897973 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18da760-6c64-447d-b140-dc8e11e6aa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.898301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18da760-6c64-447d-b140-dc8e11e6aa22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.899033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18da760-6c64-447d-b140-dc8e11e6aa22 None admin] RBAC: Adding query filter params (role.id=a3ff1ddfe66c4d2eba431a612b81a285, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=9f31f738fe094e4ea7ed440e661e2111) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:42.899342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18da760-6c64-447d-b140-dc8e11e6aa22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.900779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18da760-6c64-447d-b140-dc8e11e6aa22 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.906443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 538/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:42 2022] GET /identity/v3/role_assignments?user.id=9f31f738fe094e4ea7ed440e661e2111&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a3ff1ddfe66c4d2eba431a612b81a285 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:44.701640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38723-ace0-4136-883c-5cd5296fa919 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:44.702272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38723-ace0-4136-883c-5cd5296fa919 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:44.702272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38723-ace0-4136-883c-5cd5296fa919 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:44.703667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 569/1107] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:44.709346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e771-fb79-429f-b0a6-2febbe25ebb5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:44.709787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e771-fb79-429f-b0a6-2febbe25ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:44.709887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e771-fb79-429f-b0a6-2febbe25ebb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:44.728960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dd56e771-fb79-429f-b0a6-2febbe25ebb5 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:44.730170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dd56e771-fb79-429f-b0a6-2febbe25ebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:44.794971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 539/1108] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:45.057019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f38723-ace0-4136-883c-5cd5296fa919 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:45.086769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:45.155953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f38723-ace0-4136-883c-5cd5296fa919 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:45.189444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e33d25-8430-4f6a-8418-05c6492adeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:45.190065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e33d25-8430-4f6a-8418-05c6492adeca None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:45.190379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e33d25-8430-4f6a-8418-05c6492adeca None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:45.190655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e33d25-8430-4f6a-8418-05c6492adeca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:45.191750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e33d25-8430-4f6a-8418-05c6492adeca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:45.193180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e33d25-8430-4f6a-8418-05c6492adeca None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:45.194753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 570/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:45.200331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e771-fb79-429f-b0a6-2febbe25ebb5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:45.202461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:45.295305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56e771-fb79-429f-b0a6-2febbe25ebb5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:45.328385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441160-4162-4fb5-818a-6674b02c08c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:45.328924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441160-4162-4fb5-818a-6674b02c08c1 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:45.329205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441160-4162-4fb5-818a-6674b02c08c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:45.329478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441160-4162-4fb5-818a-6674b02c08c1 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:45.330159 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441160-4162-4fb5-818a-6674b02c08c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:45.331583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441160-4162-4fb5-818a-6674b02c08c1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:45.437082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 540/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:44:45 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:44:47.604922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75a50-f6d3-403e-8e91-f1f6b74038d5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:47.605478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75a50-f6d3-403e-8e91-f1f6b74038d5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:47.605478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75a50-f6d3-403e-8e91-f1f6b74038d5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:47.606825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 571/1111] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:47.612146 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf86acb-59bf-41f8-9b40-1f310f34b926 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:47.612543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf86acb-59bf-41f8-9b40-1f310f34b926 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:47.612686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf86acb-59bf-41f8-9b40-1f310f34b926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:47.631271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4cf86acb-59bf-41f8-9b40-1f310f34b926 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:47.632448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4cf86acb-59bf-41f8-9b40-1f310f34b926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:47.682279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:47.695476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 541/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:44:47.974127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e75a50-f6d3-403e-8e91-f1f6b74038d5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:48.068605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:48.072967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e75a50-f6d3-403e-8e91-f1f6b74038d5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:48.107754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73afd9-7b3c-4833-9f61-238929b79d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:48.108363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73afd9-7b3c-4833-9f61-238929b79d95 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:48.108641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73afd9-7b3c-4833-9f61-238929b79d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:48.108910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73afd9-7b3c-4833-9f61-238929b79d95 None admin] PATH_INFO: `/v3/roles/b622a13d8d0c4e4c832e8e3d20466938` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:48.110301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73afd9-7b3c-4833-9f61-238929b79d95 None admin] RBAC: Authorizing `identity:get_role(role_id=b622a13d8d0c4e4c832e8e3d20466938)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:48.111714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73afd9-7b3c-4833-9f61-238929b79d95 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:48.113156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 572/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:44:47 2022] GET /identity/v3/roles/b622a13d8d0c4e4c832e8e3d20466938 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:48.119030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf86acb-59bf-41f8-9b40-1f310f34b926 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:48.213675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf86acb-59bf-41f8-9b40-1f310f34b926 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:48.246052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c291098-c4ac-4892-9c90-94c952096b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:48.246688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c291098-c4ac-4892-9c90-94c952096b5b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:48.246969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c291098-c4ac-4892-9c90-94c952096b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:48.247243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c291098-c4ac-4892-9c90-94c952096b5b None admin] PATH_INFO: `/v3/users/1731790753d444299193153072100c80` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:48.260408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c291098-c4ac-4892-9c90-94c952096b5b None admin] RBAC: Authorizing `identity:get_user(user_id=1731790753d444299193153072100c80)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:48.261837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c291098-c4ac-4892-9c90-94c952096b5b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:48.263439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 542/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:44:48 2022] GET /identity/v3/users/1731790753d444299193153072100c80 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:48.269086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73afd9-7b3c-4833-9f61-238929b79d95 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:48.364749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73afd9-7b3c-4833-9f61-238929b79d95 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:48.397730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c005-a77a-4436-89e4-b899278b3a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:48.398343 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c005-a77a-4436-89e4-b899278b3a53 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:48.398625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c005-a77a-4436-89e4-b899278b3a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:48.398897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c005-a77a-4436-89e4-b899278b3a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:48.430882 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:48.464189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9c005-a77a-4436-89e4-b899278b3a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:48.465556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9c005-a77a-4436-89e4-b899278b3a53 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:48.559418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 573/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:48.565316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c291098-c4ac-4892-9c90-94c952096b5b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:48.610957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:48.661644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c291098-c4ac-4892-9c90-94c952096b5b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:48.694532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82454504-fb6b-4862-b47a-fb05c9034de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:48.695149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82454504-fb6b-4862-b47a-fb05c9034de8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:48.695433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82454504-fb6b-4862-b47a-fb05c9034de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:48.695709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82454504-fb6b-4862-b47a-fb05c9034de8 None admin] PATH_INFO: `/v3/projects/f6a4068345834673884e6473f8e5e058` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:48.696821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82454504-fb6b-4862-b47a-fb05c9034de8 None admin] RBAC: Authorizing `identity:get_project(project_id=f6a4068345834673884e6473f8e5e058)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:48.698294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82454504-fb6b-4862-b47a-fb05c9034de8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:48.699909 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 543/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:44:48 2022] GET /identity/v3/projects/f6a4068345834673884e6473f8e5e058 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:48.705958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c005-a77a-4436-89e4-b899278b3a53 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:48.767318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:48.800437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c005-a77a-4436-89e4-b899278b3a53 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:48.833541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039e32a-1159-476b-873b-4781fb46ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:48.834151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039e32a-1159-476b-873b-4781fb46ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:48.834433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039e32a-1159-476b-873b-4781fb46ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:48.834707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039e32a-1159-476b-873b-4781fb46ebf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:48.835428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039e32a-1159-476b-873b-4781fb46ebf6 None admin] RBAC: Adding query filter params (role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=f6a4068345834673884e6473f8e5e058, user.id=1731790753d444299193153072100c80) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:48.835745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039e32a-1159-476b-873b-4781fb46ebf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:48.837163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039e32a-1159-476b-873b-4781fb46ebf6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:48.842351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 574/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:48 2022] GET /identity/v3/role_assignments?user.id=1731790753d444299193153072100c80&scope.project.id=f6a4068345834673884e6473f8e5e058&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:50.924086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e23520-b733-48de-84d3-cd4b3768be9f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:50.924643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e23520-b733-48de-84d3-cd4b3768be9f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:50.924643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e23520-b733-48de-84d3-cd4b3768be9f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:50.925962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 544/1118] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:50.931779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd987-09ff-4a92-b6cc-843869b5657d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:50.932187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd987-09ff-4a92-b6cc-843869b5657d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:50.932339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd987-09ff-4a92-b6cc-843869b5657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:50.950806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-95edd987-09ff-4a92-b6cc-843869b5657d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:50.952014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-95edd987-09ff-4a92-b6cc-843869b5657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:51.015088 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 575/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:51.279852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e23520-b733-48de-84d3-cd4b3768be9f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:51.376593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e23520-b733-48de-84d3-cd4b3768be9f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:51.390321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:51.408826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94a38c-de31-446f-b672-6a7b5908ab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:51.409432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94a38c-de31-446f-b672-6a7b5908ab67 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:51.409709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94a38c-de31-446f-b672-6a7b5908ab67 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:51.409976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94a38c-de31-446f-b672-6a7b5908ab67 None admin] PATH_INFO: `/v3/roles/b622a13d8d0c4e4c832e8e3d20466938` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:51.411883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94a38c-de31-446f-b672-6a7b5908ab67 None admin] RBAC: Authorizing `identity:get_role(role_id=b622a13d8d0c4e4c832e8e3d20466938)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:51.413239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94a38c-de31-446f-b672-6a7b5908ab67 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:51.414562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 545/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:44:51 2022] GET /identity/v3/roles/b622a13d8d0c4e4c832e8e3d20466938 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:51.420323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edd987-09ff-4a92-b6cc-843869b5657d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:51.476689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:51.515896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edd987-09ff-4a92-b6cc-843869b5657d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:51.548412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e412d-d299-4ef6-9769-b0f729f89475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:51.548972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e412d-d299-4ef6-9769-b0f729f89475 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:51.549255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e412d-d299-4ef6-9769-b0f729f89475 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:51.549528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e412d-d299-4ef6-9769-b0f729f89475 None admin] PATH_INFO: `/v3/users/1731790753d444299193153072100c80` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:51.550655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e412d-d299-4ef6-9769-b0f729f89475 None admin] RBAC: Authorizing `identity:get_user(user_id=1731790753d444299193153072100c80)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:51.552081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e412d-d299-4ef6-9769-b0f729f89475 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:51.553646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 576/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:44:51 2022] GET /identity/v3/users/1731790753d444299193153072100c80 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:51.559264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94a38c-de31-446f-b672-6a7b5908ab67 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:51.654387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94a38c-de31-446f-b672-6a7b5908ab67 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:51.686812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4b825-9fed-4664-af7e-5c7fcc5cb8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:51.687425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4b825-9fed-4664-af7e-5c7fcc5cb8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:51.687709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4b825-9fed-4664-af7e-5c7fcc5cb8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:51.687983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4b825-9fed-4664-af7e-5c7fcc5cb8a3 None admin] PATH_INFO: `/v3/projects/f6a4068345834673884e6473f8e5e058` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:51.689091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4b825-9fed-4664-af7e-5c7fcc5cb8a3 None admin] RBAC: Authorizing `identity:get_project(project_id=f6a4068345834673884e6473f8e5e058)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:51.690546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4b825-9fed-4664-af7e-5c7fcc5cb8a3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:51.692150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 546/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:44:51 2022] GET /identity/v3/projects/f6a4068345834673884e6473f8e5e058 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:51.697737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e412d-d299-4ef6-9769-b0f729f89475 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:51.794927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e412d-d299-4ef6-9769-b0f729f89475 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:51.819628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:51.827030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce882e5d-5c8b-4aec-94dc-8ad61b6bb5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:51.827677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce882e5d-5c8b-4aec-94dc-8ad61b6bb5bb None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:51.827961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce882e5d-5c8b-4aec-94dc-8ad61b6bb5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:51.828240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce882e5d-5c8b-4aec-94dc-8ad61b6bb5bb None admin] PATH_INFO: `/v3/projects/f6a4068345834673884e6473f8e5e058/users/1731790753d444299193153072100c80/roles/b622a13d8d0c4e4c832e8e3d20466938` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:51.831034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce882e5d-5c8b-4aec-94dc-8ad61b6bb5bb None admin] RBAC: Authorizing `identity:create_grant(project_id=f6a4068345834673884e6473f8e5e058, user_id=1731790753d444299193153072100c80, role_id=b622a13d8d0c4e4c832e8e3d20466938)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:51.831850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce882e5d-5c8b-4aec-94dc-8ad61b6bb5bb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:51.905560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 577/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:44:51 2022] PUT /identity/v3/projects/f6a4068345834673884e6473f8e5e058/users/1731790753d444299193153072100c80/roles/b622a13d8d0c4e4c832e8e3d20466938 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:44:54.004982 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fb6e7-1abd-483e-908b-b9c0391bfe2b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:54.005463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fb6e7-1abd-483e-908b-b9c0391bfe2b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:54.005548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fb6e7-1abd-483e-908b-b9c0391bfe2b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:54.006884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 547/1124] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:54.012073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d3d6f-672c-45af-8b79-cb117995bec7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:54.012505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d3d6f-672c-45af-8b79-cb117995bec7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:54.012626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d3d6f-672c-45af-8b79-cb117995bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:54.030803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4f8d3d6f-672c-45af-8b79-cb117995bec7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:54.031981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4f8d3d6f-672c-45af-8b79-cb117995bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:54.096478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 578/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:54.363256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fb6e7-1abd-483e-908b-b9c0391bfe2b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:54.412081 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:54.459790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fb6e7-1abd-483e-908b-b9c0391bfe2b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:54.492395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf87e-8d78-4925-b68a-f3806f93b282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:54.493011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf87e-8d78-4925-b68a-f3806f93b282 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:54.493291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf87e-8d78-4925-b68a-f3806f93b282 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:54.493563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf87e-8d78-4925-b68a-f3806f93b282 None admin] PATH_INFO: `/v3/roles/b622a13d8d0c4e4c832e8e3d20466938` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:54.494967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf87e-8d78-4925-b68a-f3806f93b282 None admin] RBAC: Authorizing `identity:get_role(role_id=b622a13d8d0c4e4c832e8e3d20466938)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:54.496328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf87e-8d78-4925-b68a-f3806f93b282 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:54.497628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 548/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:44:54 2022] GET /identity/v3/roles/b622a13d8d0c4e4c832e8e3d20466938 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:54.503180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d3d6f-672c-45af-8b79-cb117995bec7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:54.597217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d3d6f-672c-45af-8b79-cb117995bec7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:54.614247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:54.630605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e9d65-9796-4e56-9e1e-6953b70679e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:54.631224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e9d65-9796-4e56-9e1e-6953b70679e0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:54.632079 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e9d65-9796-4e56-9e1e-6953b70679e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:54.632079 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e9d65-9796-4e56-9e1e-6953b70679e0 None admin] PATH_INFO: `/v3/users/1731790753d444299193153072100c80` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:54.632914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e9d65-9796-4e56-9e1e-6953b70679e0 None admin] RBAC: Authorizing `identity:get_user(user_id=1731790753d444299193153072100c80)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:54.634370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e9d65-9796-4e56-9e1e-6953b70679e0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:54.635916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 579/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:44:54 2022] GET /identity/v3/users/1731790753d444299193153072100c80 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:54.641592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf87e-8d78-4925-b68a-f3806f93b282 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:54.736216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf87e-8d78-4925-b68a-f3806f93b282 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:54.752912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:54.769269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be760e-647b-461f-bc1f-5333f358c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:54.769865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be760e-647b-461f-bc1f-5333f358c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:54.770201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be760e-647b-461f-bc1f-5333f358c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:54.770481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be760e-647b-461f-bc1f-5333f358c7d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:54.833806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be760e-647b-461f-bc1f-5333f358c7d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:54.835275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be760e-647b-461f-bc1f-5333f358c7d5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:54.928806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 549/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:44:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:44:54.934680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e9d65-9796-4e56-9e1e-6953b70679e0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:55.030400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e9d65-9796-4e56-9e1e-6953b70679e0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:55.062987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aac32-c895-4699-9087-c4dae107c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:55.063590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aac32-c895-4699-9087-c4dae107c4ca None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:55.063868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aac32-c895-4699-9087-c4dae107c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:55.064139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aac32-c895-4699-9087-c4dae107c4ca None admin] PATH_INFO: `/v3/projects/f6a4068345834673884e6473f8e5e058` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:55.065234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aac32-c895-4699-9087-c4dae107c4ca None admin] RBAC: Authorizing `identity:get_project(project_id=f6a4068345834673884e6473f8e5e058)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:55.066685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aac32-c895-4699-9087-c4dae107c4ca None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:55.068313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 580/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:44:54 2022] GET /identity/v3/projects/f6a4068345834673884e6473f8e5e058 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:44:55.074404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be760e-647b-461f-bc1f-5333f358c7d5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:55.091869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:55.168670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be760e-647b-461f-bc1f-5333f358c7d5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:55.200967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d68172-8d5e-41cf-ad59-d01684344412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:55.201500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d68172-8d5e-41cf-ad59-d01684344412 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:55.201781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d68172-8d5e-41cf-ad59-d01684344412 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:55.202055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d68172-8d5e-41cf-ad59-d01684344412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:55.202810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d68172-8d5e-41cf-ad59-d01684344412 None admin] RBAC: Adding query filter params (role.id=b622a13d8d0c4e4c832e8e3d20466938, scope.project.id=f6a4068345834673884e6473f8e5e058, user.id=1731790753d444299193153072100c80) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:44:55.203118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d68172-8d5e-41cf-ad59-d01684344412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:55.204539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d68172-8d5e-41cf-ad59-d01684344412 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:55.210036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 550/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:44:55 2022] GET /identity/v3/role_assignments?user.id=1731790753d444299193153072100c80&scope.project.id=f6a4068345834673884e6473f8e5e058&role.id=b622a13d8d0c4e4c832e8e3d20466938 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:57.329390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db700fa6-088e-45b4-a950-b1b7d10c7c2f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:57.329888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db700fa6-088e-45b4-a950-b1b7d10c7c2f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:57.329996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db700fa6-088e-45b4-a950-b1b7d10c7c2f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:57.331330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 581/1131] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:57.337091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eabf0-2382-469a-8df3-aeda16465a07 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:57.337508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eabf0-2382-469a-8df3-aeda16465a07 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:57.337642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eabf0-2382-469a-8df3-aeda16465a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:57.356433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-551eabf0-2382-469a-8df3-aeda16465a07 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:57.357613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-551eabf0-2382-469a-8df3-aeda16465a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:57.420978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 551/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:44:57.686963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db700fa6-088e-45b4-a950-b1b7d10c7c2f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:57.742042 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:57.786015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db700fa6-088e-45b4-a950-b1b7d10c7c2f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:57.819153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1db18e-d2b2-46a7-85ab-219154813171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:57.819764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1db18e-d2b2-46a7-85ab-219154813171 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:57.820042 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1db18e-d2b2-46a7-85ab-219154813171 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:57.820309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1db18e-d2b2-46a7-85ab-219154813171 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:57.821403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1db18e-d2b2-46a7-85ab-219154813171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:57.823020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1db18e-d2b2-46a7-85ab-219154813171 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:57.824655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 582/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:44:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:44:57.830424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eabf0-2382-469a-8df3-aeda16465a07 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:57.843945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:57.925133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eabf0-2382-469a-8df3-aeda16465a07 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:57.958205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113314a8-cb3d-4056-b49c-58d308a4bb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:57.958816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113314a8-cb3d-4056-b49c-58d308a4bb51 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:57.959097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113314a8-cb3d-4056-b49c-58d308a4bb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:57.959371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113314a8-cb3d-4056-b49c-58d308a4bb51 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:57.960028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113314a8-cb3d-4056-b49c-58d308a4bb51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:57.961458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113314a8-cb3d-4056-b49c-58d308a4bb51 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:58.077829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 552/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:44:57 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:00.215328 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581f322-ecac-435b-bac2-40fb0df3e9d2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:00.215845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581f322-ecac-435b-bac2-40fb0df3e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:00.215845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581f322-ecac-435b-bac2-40fb0df3e9d2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:00.217156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 583/1135] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:00.222452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2e3f-7636-404b-a6cc-44b26429c4f2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:00.223354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2e3f-7636-404b-a6cc-44b26429c4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:00.223509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2e3f-7636-404b-a6cc-44b26429c4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:00.242127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bcef2e3f-7636-404b-a6cc-44b26429c4f2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:00.243308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bcef2e3f-7636-404b-a6cc-44b26429c4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:00.297770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:00.306159 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 553/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:00.578236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581f322-ecac-435b-bac2-40fb0df3e9d2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:00.676766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581f322-ecac-435b-bac2-40fb0df3e9d2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:00.698097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:00.709570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b6798-e8c7-47ed-8bbd-526c4af35bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:00.710233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b6798-e8c7-47ed-8bbd-526c4af35bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:00.710517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b6798-e8c7-47ed-8bbd-526c4af35bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:00.710793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b6798-e8c7-47ed-8bbd-526c4af35bf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:00.711903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b6798-e8c7-47ed-8bbd-526c4af35bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:00.713337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b6798-e8c7-47ed-8bbd-526c4af35bf2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:00.714927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 584/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:45:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:00.720562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef2e3f-7636-404b-a6cc-44b26429c4f2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:00.815407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef2e3f-7636-404b-a6cc-44b26429c4f2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:00.848625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1c815-50d2-4b6b-b002-f3b84af311f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:00.849160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c815-50d2-4b6b-b002-f3b84af311f6 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:00.849456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c815-50d2-4b6b-b002-f3b84af311f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:00.849762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c815-50d2-4b6b-b002-f3b84af311f6 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:00.850449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1c815-50d2-4b6b-b002-f3b84af311f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:00.852141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1c815-50d2-4b6b-b002-f3b84af311f6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:00.944718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 554/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:45:00 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:03.093258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c63d4-77b3-4f52-a9a4-78276b100250 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:03.093797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c63d4-77b3-4f52-a9a4-78276b100250 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:03.093797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c63d4-77b3-4f52-a9a4-78276b100250 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:03.095192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 585/1139] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:03.101371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951f271-a860-405a-900c-ba3bdf68a145 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:03.101767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951f271-a860-405a-900c-ba3bdf68a145 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:03.101916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951f271-a860-405a-900c-ba3bdf68a145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:03.119616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f951f271-a860-405a-900c-ba3bdf68a145 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:03.120800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f951f271-a860-405a-900c-ba3bdf68a145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:03.165131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:03.184574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 555/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:03.451126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c63d4-77b3-4f52-a9a4-78276b100250 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:03.548333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c63d4-77b3-4f52-a9a4-78276b100250 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:03.581331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f1c34-b276-4531-b9db-ca2f29c48742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:03.581963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f1c34-b276-4531-b9db-ca2f29c48742 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:03.582273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f1c34-b276-4531-b9db-ca2f29c48742 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:03.582550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f1c34-b276-4531-b9db-ca2f29c48742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:03.592139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f1c34-b276-4531-b9db-ca2f29c48742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9e8f1c34-b276-4531-b9db-ca2f29c48742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:45:03.596919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:45:03.598015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:45:03.599077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 586/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:45:03.604182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951f271-a860-405a-900c-ba3bdf68a145 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:03.697656 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951f271-a860-405a-900c-ba3bdf68a145 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:03.729503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a938-6885-4096-b6db-743728a7a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:03.730040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a938-6885-4096-b6db-743728a7a00f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:03.730354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a938-6885-4096-b6db-743728a7a00f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:03.730626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a938-6885-4096-b6db-743728a7a00f None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:03.731286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380a938-6885-4096-b6db-743728a7a00f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:03.731590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380a938-6885-4096-b6db-743728a7a00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:03.732948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380a938-6885-4096-b6db-743728a7a00f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:03.741138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 556/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:03.746843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f1c34-b276-4531-b9db-ca2f29c48742 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:03.795725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:03.844014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f1c34-b276-4531-b9db-ca2f29c48742 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:03.877283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776edf-616b-4da6-ada4-af330584e743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:03.877887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776edf-616b-4da6-ada4-af330584e743 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:03.878194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776edf-616b-4da6-ada4-af330584e743 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:03.878470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28776edf-616b-4da6-ada4-af330584e743 None admin] PATH_INFO: `/v3/users/8d251d051fad492ebaeedf3b69511be8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:03.890914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776edf-616b-4da6-ada4-af330584e743 None admin] RBAC: Authorizing `identity:get_user(user_id=8d251d051fad492ebaeedf3b69511be8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:03.892357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28776edf-616b-4da6-ada4-af330584e743 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:03.893936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 587/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:45:03 2022] GET /identity/v3/users/8d251d051fad492ebaeedf3b69511be8 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:03.899770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a938-6885-4096-b6db-743728a7a00f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:03.960856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:04.014977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a938-6885-4096-b6db-743728a7a00f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:04.046684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3892618-f37c-4dac-beba-fabc01547a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:04.047274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892618-f37c-4dac-beba-fabc01547a6a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:04.047551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892618-f37c-4dac-beba-fabc01547a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:04.047819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3892618-f37c-4dac-beba-fabc01547a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:04.111391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3892618-f37c-4dac-beba-fabc01547a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:04.112824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3892618-f37c-4dac-beba-fabc01547a6a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:04.151280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:04.205145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 557/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:45:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:04.211135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776edf-616b-4da6-ada4-af330584e743 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:04.307096 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28776edf-616b-4da6-ada4-af330584e743 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:04.315796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:04.339758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9856-43e2-4fa0-a5cd-a6b3bf79fc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:04.340375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9856-43e2-4fa0-a5cd-a6b3bf79fc79 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:04.340659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9856-43e2-4fa0-a5cd-a6b3bf79fc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:04.340937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9856-43e2-4fa0-a5cd-a6b3bf79fc79 None admin] PATH_INFO: `/v3/projects/c337dbad019242808f3035b6f5fedbfd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:04.342049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa9856-43e2-4fa0-a5cd-a6b3bf79fc79 None admin] RBAC: Authorizing `identity:get_project(project_id=c337dbad019242808f3035b6f5fedbfd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:04.343544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa9856-43e2-4fa0-a5cd-a6b3bf79fc79 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:04.345502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 588/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:45:04 2022] GET /identity/v3/projects/c337dbad019242808f3035b6f5fedbfd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:04.352330 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3892618-f37c-4dac-beba-fabc01547a6a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:04.446364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3892618-f37c-4dac-beba-fabc01547a6a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:04.479470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17a19e-e52f-46cc-8633-a94d46d0d83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:04.480054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17a19e-e52f-46cc-8633-a94d46d0d83a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:04.480331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17a19e-e52f-46cc-8633-a94d46d0d83a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:04.480600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17a19e-e52f-46cc-8633-a94d46d0d83a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:04.481309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17a19e-e52f-46cc-8633-a94d46d0d83a None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=c337dbad019242808f3035b6f5fedbfd, user.id=8d251d051fad492ebaeedf3b69511be8) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:04.481614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17a19e-e52f-46cc-8633-a94d46d0d83a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:04.483047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17a19e-e52f-46cc-8633-a94d46d0d83a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:04.488218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 558/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:45:04 2022] GET /identity/v3/role_assignments?user.id=8d251d051fad492ebaeedf3b69511be8&scope.project.id=c337dbad019242808f3035b6f5fedbfd&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:06.570210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d67f-b092-4b0f-9bb4-2b62c94543d6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:06.570763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d67f-b092-4b0f-9bb4-2b62c94543d6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:06.570763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131d67f-b092-4b0f-9bb4-2b62c94543d6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:06.572113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 589/1147] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:06.577328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fff91-0673-4e49-adf1-2f67af9d5d03 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:06.577726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fff91-0673-4e49-adf1-2f67af9d5d03 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:06.577869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fff91-0673-4e49-adf1-2f67af9d5d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:06.590930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:06.596259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-522fff91-0673-4e49-adf1-2f67af9d5d03 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:06.598040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-522fff91-0673-4e49-adf1-2f67af9d5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:06.663339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 559/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:06.928230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d67f-b092-4b0f-9bb4-2b62c94543d6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:07.025788 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131d67f-b092-4b0f-9bb4-2b62c94543d6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:07.057374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e563-e330-4124-8347-31c0f9a354cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:07.057982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e563-e330-4124-8347-31c0f9a354cd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:07.058286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e563-e330-4124-8347-31c0f9a354cd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:07.058556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05e563-e330-4124-8347-31c0f9a354cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:07.068739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05e563-e330-4124-8347-31c0f9a354cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bf05e563-e330-4124-8347-31c0f9a354cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:45:07.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:45:07.074621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:45:07.075818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 590/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:45:07.080478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fff91-0673-4e49-adf1-2f67af9d5d03 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:07.175290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fff91-0673-4e49-adf1-2f67af9d5d03 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:07.208278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8b676-6c71-4151-a5cf-3f6683f56b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:07.208812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b676-6c71-4151-a5cf-3f6683f56b40 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:07.209095 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b676-6c71-4151-a5cf-3f6683f56b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:07.209370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b676-6c71-4151-a5cf-3f6683f56b40 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:07.210038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8b676-6c71-4151-a5cf-3f6683f56b40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:07.210376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8b676-6c71-4151-a5cf-3f6683f56b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:07.211743 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8b676-6c71-4151-a5cf-3f6683f56b40 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:07.213830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:07.219828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 560/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:07.225391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e563-e330-4124-8347-31c0f9a354cd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:07.260368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:07.320916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05e563-e330-4124-8347-31c0f9a354cd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:07.352908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedea3d-1bc9-4f2e-bce7-9ddd209ed3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:07.353516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedea3d-1bc9-4f2e-bce7-9ddd209ed3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:07.353796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedea3d-1bc9-4f2e-bce7-9ddd209ed3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:07.354068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedea3d-1bc9-4f2e-bce7-9ddd209ed3c2 None admin] PATH_INFO: `/v3/users/8d251d051fad492ebaeedf3b69511be8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:07.355198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedea3d-1bc9-4f2e-bce7-9ddd209ed3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=8d251d051fad492ebaeedf3b69511be8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:07.356618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedea3d-1bc9-4f2e-bce7-9ddd209ed3c2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:07.358174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 591/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:45:07 2022] GET /identity/v3/users/8d251d051fad492ebaeedf3b69511be8 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:07.364486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8b676-6c71-4151-a5cf-3f6683f56b40 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:07.458737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8b676-6c71-4151-a5cf-3f6683f56b40 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:07.490094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e0d94-956b-45ac-abe8-6b47aadd7a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:07.490716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e0d94-956b-45ac-abe8-6b47aadd7a78 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:07.490995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e0d94-956b-45ac-abe8-6b47aadd7a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:07.491266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e0d94-956b-45ac-abe8-6b47aadd7a78 None admin] PATH_INFO: `/v3/projects/c337dbad019242808f3035b6f5fedbfd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:07.492357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e0d94-956b-45ac-abe8-6b47aadd7a78 None admin] RBAC: Authorizing `identity:get_project(project_id=c337dbad019242808f3035b6f5fedbfd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:07.493765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e0d94-956b-45ac-abe8-6b47aadd7a78 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:07.495388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 561/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:45:07 2022] GET /identity/v3/projects/c337dbad019242808f3035b6f5fedbfd => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:07.501104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedea3d-1bc9-4f2e-bce7-9ddd209ed3c2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:07.595892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedea3d-1bc9-4f2e-bce7-9ddd209ed3c2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:07.598644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:07.628810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f991566-91b5-4b2c-a569-a99101cf0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:07.629466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f991566-91b5-4b2c-a569-a99101cf0bb4 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:07.629754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f991566-91b5-4b2c-a569-a99101cf0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:07.630262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f991566-91b5-4b2c-a569-a99101cf0bb4 None admin] PATH_INFO: `/v3/projects/c337dbad019242808f3035b6f5fedbfd/users/8d251d051fad492ebaeedf3b69511be8/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:07.632499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f991566-91b5-4b2c-a569-a99101cf0bb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c337dbad019242808f3035b6f5fedbfd, user_id=8d251d051fad492ebaeedf3b69511be8, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:07.633924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f991566-91b5-4b2c-a569-a99101cf0bb4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:07.699221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 592/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:45:07 2022] PUT /identity/v3/projects/c337dbad019242808f3035b6f5fedbfd/users/8d251d051fad492ebaeedf3b69511be8/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:45:09.805780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284734-3bab-4681-83d8-7874f5e88b54 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:09.806341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284734-3bab-4681-83d8-7874f5e88b54 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:09.806341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284734-3bab-4681-83d8-7874f5e88b54 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:09.807709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 562/1154] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:09.813138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b39e70-1ea6-412d-9223-78aa35843bcf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:09.813512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b39e70-1ea6-412d-9223-78aa35843bcf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:09.813685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b39e70-1ea6-412d-9223-78aa35843bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:09.834576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-55b39e70-1ea6-412d-9223-78aa35843bcf None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:09.835998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-55b39e70-1ea6-412d-9223-78aa35843bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:09.900186 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 593/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:10.170258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284734-3bab-4681-83d8-7874f5e88b54 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:10.235657 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:10.269979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284734-3bab-4681-83d8-7874f5e88b54 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:10.302564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe065ff-a1c0-43d5-8618-53e395b5b8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:10.303177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe065ff-a1c0-43d5-8618-53e395b5b8bd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:10.303457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe065ff-a1c0-43d5-8618-53e395b5b8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:10.303730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe065ff-a1c0-43d5-8618-53e395b5b8bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:10.313765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe065ff-a1c0-43d5-8618-53e395b5b8bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4fe065ff-a1c0-43d5-8618-53e395b5b8bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:45:10.319167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:45:10.320246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:45:10.321271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 563/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:45:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:45:10.326282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b39e70-1ea6-412d-9223-78aa35843bcf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:10.413300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:10.419698 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b39e70-1ea6-412d-9223-78aa35843bcf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:10.452961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee409-4cd1-4f29-8f64-f4ac773a9674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:10.453490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee409-4cd1-4f29-8f64-f4ac773a9674 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:10.453766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee409-4cd1-4f29-8f64-f4ac773a9674 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:10.454036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ee409-4cd1-4f29-8f64-f4ac773a9674 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:10.454715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee409-4cd1-4f29-8f64-f4ac773a9674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:10.455014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee409-4cd1-4f29-8f64-f4ac773a9674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:10.456373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ee409-4cd1-4f29-8f64-f4ac773a9674 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:10.464400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 594/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:10.469963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe065ff-a1c0-43d5-8618-53e395b5b8bd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:10.563961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe065ff-a1c0-43d5-8618-53e395b5b8bd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:10.587642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:10.595720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a9dc7-2526-4b71-958d-22aaaeaf2d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:10.601587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9dc7-2526-4b71-958d-22aaaeaf2d9e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:10.601587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9dc7-2526-4b71-958d-22aaaeaf2d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:10.601587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9dc7-2526-4b71-958d-22aaaeaf2d9e None admin] PATH_INFO: `/v3/users/8d251d051fad492ebaeedf3b69511be8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:10.601587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a9dc7-2526-4b71-958d-22aaaeaf2d9e None admin] RBAC: Authorizing `identity:get_user(user_id=8d251d051fad492ebaeedf3b69511be8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:10.601587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a9dc7-2526-4b71-958d-22aaaeaf2d9e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:10.601997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 564/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:45:10 2022] GET /identity/v3/users/8d251d051fad492ebaeedf3b69511be8 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:10.607401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee409-4cd1-4f29-8f64-f4ac773a9674 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:10.703043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ee409-4cd1-4f29-8f64-f4ac773a9674 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:10.734886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce1dd-db6e-44df-841e-a1b6f925b188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:10.735475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce1dd-db6e-44df-841e-a1b6f925b188 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:10.735753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce1dd-db6e-44df-841e-a1b6f925b188 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:10.736025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce1dd-db6e-44df-841e-a1b6f925b188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:10.759429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:10.801333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ce1dd-db6e-44df-841e-a1b6f925b188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:10.802805 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ce1dd-db6e-44df-841e-a1b6f925b188 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:10.896079 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 595/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:45:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:10.901727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a9dc7-2526-4b71-958d-22aaaeaf2d9e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:10.997501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a9dc7-2526-4b71-958d-22aaaeaf2d9e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:11.029000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e16a2e-e395-4351-8361-68d3f934aa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:11.029609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e16a2e-e395-4351-8361-68d3f934aa8f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.029886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e16a2e-e395-4351-8361-68d3f934aa8f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.030180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e16a2e-e395-4351-8361-68d3f934aa8f None admin] PATH_INFO: `/v3/projects/c337dbad019242808f3035b6f5fedbfd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.031276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e16a2e-e395-4351-8361-68d3f934aa8f None admin] RBAC: Authorizing `identity:get_project(project_id=c337dbad019242808f3035b6f5fedbfd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:11.032693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e16a2e-e395-4351-8361-68d3f934aa8f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:11.034316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 565/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:45:10 2022] GET /identity/v3/projects/c337dbad019242808f3035b6f5fedbfd => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:11.040830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce1dd-db6e-44df-841e-a1b6f925b188 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:11.093719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:11.140021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce1dd-db6e-44df-841e-a1b6f925b188 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:11.173519 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b6391-9cac-497f-ae6b-11d84c5c3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:11.174136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b6391-9cac-497f-ae6b-11d84c5c3dff None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.174415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b6391-9cac-497f-ae6b-11d84c5c3dff None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.174685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b6391-9cac-497f-ae6b-11d84c5c3dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.175404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b6391-9cac-497f-ae6b-11d84c5c3dff None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=c337dbad019242808f3035b6f5fedbfd, user.id=8d251d051fad492ebaeedf3b69511be8) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:11.175712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b6391-9cac-497f-ae6b-11d84c5c3dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:11.177135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b6391-9cac-497f-ae6b-11d84c5c3dff None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:11.182641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 596/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:45:11 2022] GET /identity/v3/role_assignments?user.id=8d251d051fad492ebaeedf3b69511be8&scope.project.id=c337dbad019242808f3035b6f5fedbfd&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:13.317616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deec65-4a68-40ce-be09-9c069eb2c509 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.318170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deec65-4a68-40ce-be09-9c069eb2c509 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.318170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deec65-4a68-40ce-be09-9c069eb2c509 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.319446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 566/1162] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:13.324569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396423f-f4cb-43e1-a1d5-11eee59c2804 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.324991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396423f-f4cb-43e1-a1d5-11eee59c2804 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.325124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396423f-f4cb-43e1-a1d5-11eee59c2804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.343493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b396423f-f4cb-43e1-a1d5-11eee59c2804 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:13.344660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b396423f-f4cb-43e1-a1d5-11eee59c2804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:13.407818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 597/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:13.672803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deec65-4a68-40ce-be09-9c069eb2c509 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:13.732534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:13.770265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deec65-4a68-40ce-be09-9c069eb2c509 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:13.801405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256dc7f-dda7-414e-8edc-8a2e18b3c88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:13.801989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256dc7f-dda7-414e-8edc-8a2e18b3c88e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.802293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256dc7f-dda7-414e-8edc-8a2e18b3c88e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.802565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256dc7f-dda7-414e-8edc-8a2e18b3c88e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.865322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256dc7f-dda7-414e-8edc-8a2e18b3c88e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:13.866777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256dc7f-dda7-414e-8edc-8a2e18b3c88e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:13.922035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:13.961161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 567/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:45:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:13.967058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396423f-f4cb-43e1-a1d5-11eee59c2804 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:14.014885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:14.061604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396423f-f4cb-43e1-a1d5-11eee59c2804 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:14.093514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b484a-57fc-4d7f-a2f2-47547cd827e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:14.094154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b484a-57fc-4d7f-a2f2-47547cd827e8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:14.094436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b484a-57fc-4d7f-a2f2-47547cd827e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:14.094711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b484a-57fc-4d7f-a2f2-47547cd827e8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:14.101323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b484a-57fc-4d7f-a2f2-47547cd827e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:14.102789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b484a-57fc-4d7f-a2f2-47547cd827e8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3b2b484a-57fc-4d7f-a2f2-47547cd827e8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:45:14.114235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:45:14.115496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:45:14.116603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 598/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:45:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:45:14.121345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256dc7f-dda7-414e-8edc-8a2e18b3c88e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:14.215730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256dc7f-dda7-414e-8edc-8a2e18b3c88e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:14.248155 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20ca1b-7453-4e2f-8b6b-705675886b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:14.248742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ca1b-7453-4e2f-8b6b-705675886b33 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:14.249020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ca1b-7453-4e2f-8b6b-705675886b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:14.249290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ca1b-7453-4e2f-8b6b-705675886b33 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:14.249928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20ca1b-7453-4e2f-8b6b-705675886b33 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:14.250257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20ca1b-7453-4e2f-8b6b-705675886b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:14.251606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20ca1b-7453-4e2f-8b6b-705675886b33 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:14.259017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 568/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Oct 4 08:45:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:16.351331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4592b6-f732-4f8b-82d6-61e0d0272212 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.351843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4592b6-f732-4f8b-82d6-61e0d0272212 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.351843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4592b6-f732-4f8b-82d6-61e0d0272212 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.353150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 599/1167] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:16.358455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b8493-aedd-480e-a17d-d77f4b73fb66 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.358825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b8493-aedd-480e-a17d-d77f4b73fb66 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.359009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b8493-aedd-480e-a17d-d77f4b73fb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.377174 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ae2b8493-aedd-480e-a17d-d77f4b73fb66 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:16.379026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ae2b8493-aedd-480e-a17d-d77f4b73fb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:16.398231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:16.443323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 569/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:16.709309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4592b6-f732-4f8b-82d6-61e0d0272212 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.807108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4592b6-f732-4f8b-82d6-61e0d0272212 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.817196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:16.839072 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd161f7d-1ee9-42a2-ab64-f2673cb1868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.839658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd161f7d-1ee9-42a2-ab64-f2673cb1868e None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.839970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd161f7d-1ee9-42a2-ab64-f2673cb1868e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.840272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd161f7d-1ee9-42a2-ab64-f2673cb1868e None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.840949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd161f7d-1ee9-42a2-ab64-f2673cb1868e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.842347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd161f7d-1ee9-42a2-ab64-f2673cb1868e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.911208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 600/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/domains => generated 267 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:19.059587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1640267-2648-4774-8921-c0d9dae331b1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:19.060133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1640267-2648-4774-8921-c0d9dae331b1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:19.060133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1640267-2648-4774-8921-c0d9dae331b1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:19.061490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 570/1170] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:19.067250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8b568-5d60-4dcd-9a95-f73941963370 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:19.067637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8b568-5d60-4dcd-9a95-f73941963370 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:19.067799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8b568-5d60-4dcd-9a95-f73941963370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:19.086058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-66d8b568-5d60-4dcd-9a95-f73941963370 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:19.087260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66d8b568-5d60-4dcd-9a95-f73941963370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:19.150620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 601/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:19.420552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1640267-2648-4774-8921-c0d9dae331b1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:19.518292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1640267-2648-4774-8921-c0d9dae331b1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:19.550594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776399d3-2319-488a-9f76-5c9670394107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:19.551211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776399d3-2319-488a-9f76-5c9670394107 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:19.551497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776399d3-2319-488a-9f76-5c9670394107 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:19.551774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776399d3-2319-488a-9f76-5c9670394107 None admin] PATH_INFO: `/v3/domains/bb50174002e94f90bbedbe3fbfeff475` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:19.561763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776399d3-2319-488a-9f76-5c9670394107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bb50174002e94f90bbedbe3fbfeff475)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:19.563230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776399d3-2319-488a-9f76-5c9670394107 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:19.564792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 571/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Oct 4 08:45:19 2022] GET /identity/v3/domains/bb50174002e94f90bbedbe3fbfeff475 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:19.571035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8b568-5d60-4dcd-9a95-f73941963370 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:19.662573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:19.665375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8b568-5d60-4dcd-9a95-f73941963370 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:19.699220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ace1bd-ef1b-4ce8-adc9-667de143db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:19.699762 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace1bd-ef1b-4ce8-adc9-667de143db58 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:19.700041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace1bd-ef1b-4ce8-adc9-667de143db58 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:19.700314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace1bd-ef1b-4ce8-adc9-667de143db58 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:19.700969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ace1bd-ef1b-4ce8-adc9-667de143db58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:19.702426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ace1bd-ef1b-4ce8-adc9-667de143db58 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:19.808097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 602/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:45:19 2022] POST /identity/v3/projects => generated 361 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:45:21.931449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ccc95-8ff0-4d5a-b33d-363d707c8b49 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:21.931993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ccc95-8ff0-4d5a-b33d-363d707c8b49 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:21.931993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ccc95-8ff0-4d5a-b33d-363d707c8b49 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:21.933334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 572/1174] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:21.938785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e939d-95eb-44e3-8d51-ffd0ebe6f6ef None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:21.939176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e939d-95eb-44e3-8d51-ffd0ebe6f6ef None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:21.939337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e939d-95eb-44e3-8d51-ffd0ebe6f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:21.960365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f40e939d-95eb-44e3-8d51-ffd0ebe6f6ef None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:21.961542 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f40e939d-95eb-44e3-8d51-ffd0ebe6f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:22.024195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 603/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:22.290272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ccc95-8ff0-4d5a-b33d-363d707c8b49 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:22.308793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:22.389849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ccc95-8ff0-4d5a-b33d-363d707c8b49 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:22.421413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c957ef-c200-49e3-a3de-6472cf664298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:22.422026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c957ef-c200-49e3-a3de-6472cf664298 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:22.422338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c957ef-c200-49e3-a3de-6472cf664298 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:22.422611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c957ef-c200-49e3-a3de-6472cf664298 None admin] PATH_INFO: `/v3/domains/bb50174002e94f90bbedbe3fbfeff475` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:22.423718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c957ef-c200-49e3-a3de-6472cf664298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bb50174002e94f90bbedbe3fbfeff475)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:22.425637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c957ef-c200-49e3-a3de-6472cf664298 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:22.427215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 573/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Oct 4 08:45:22 2022] GET /identity/v3/domains/bb50174002e94f90bbedbe3fbfeff475 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:22.432947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e939d-95eb-44e3-8d51-ffd0ebe6f6ef None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:22.509588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:22.526394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e939d-95eb-44e3-8d51-ffd0ebe6f6ef None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:22.559046 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc1dfb-fffe-48e1-9957-f0ea756e39aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:22.559583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc1dfb-fffe-48e1-9957-f0ea756e39aa None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:22.559862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc1dfb-fffe-48e1-9957-f0ea756e39aa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:22.560185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc1dfb-fffe-48e1-9957-f0ea756e39aa None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:22.560876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc1dfb-fffe-48e1-9957-f0ea756e39aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:22.562323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc1dfb-fffe-48e1-9957-f0ea756e39aa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:22.647624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 604/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:45:22 2022] POST /identity/v3/users => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:45:24.787882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02af9-817d-40dc-b9cc-8b784630604f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:24.788463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02af9-817d-40dc-b9cc-8b784630604f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:24.788463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02af9-817d-40dc-b9cc-8b784630604f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:24.789779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 574/1178] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:24.795141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06be22-127e-4702-9410-8b1484f894dc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:24.795561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06be22-127e-4702-9410-8b1484f894dc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:24.795688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06be22-127e-4702-9410-8b1484f894dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:24.813764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1a06be22-127e-4702-9410-8b1484f894dc None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:24.815508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1a06be22-127e-4702-9410-8b1484f894dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:24.878909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 605/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:25.143669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a02af9-817d-40dc-b9cc-8b784630604f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:25.225069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:25.241248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a02af9-817d-40dc-b9cc-8b784630604f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:25.273550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941f86c-f511-45df-8939-30d23cd34d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:25.274190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941f86c-f511-45df-8939-30d23cd34d21 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:25.274474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941f86c-f511-45df-8939-30d23cd34d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:25.274747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941f86c-f511-45df-8939-30d23cd34d21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:25.284828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941f86c-f511-45df-8939-30d23cd34d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0941f86c-f511-45df-8939-30d23cd34d21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:45:25.289573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:45:25.290774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:45:25.291664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 575/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:45:25.296494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06be22-127e-4702-9410-8b1484f894dc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:25.358833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:25.390025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06be22-127e-4702-9410-8b1484f894dc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:25.423075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a03be7-a2d0-4833-bb36-f7271173eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:25.423617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03be7-a2d0-4833-bb36-f7271173eb91 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:25.423895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03be7-a2d0-4833-bb36-f7271173eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:25.424164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03be7-a2d0-4833-bb36-f7271173eb91 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:25.424846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a03be7-a2d0-4833-bb36-f7271173eb91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:25.425147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a03be7-a2d0-4833-bb36-f7271173eb91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:25.426543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a03be7-a2d0-4833-bb36-f7271173eb91 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:25.434026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 606/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:25.439763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941f86c-f511-45df-8939-30d23cd34d21 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:25.535350 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941f86c-f511-45df-8939-30d23cd34d21 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:25.566450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f1bb-3369-4920-bd00-6a60a3222c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:25.567057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f1bb-3369-4920-bd00-6a60a3222c1b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:25.567334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f1bb-3369-4920-bd00-6a60a3222c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:25.567604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f1bb-3369-4920-bd00-6a60a3222c1b None admin] PATH_INFO: `/v3/users/3147c8ce67f34653b3161cd8b4054108` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:25.579874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5f1bb-3369-4920-bd00-6a60a3222c1b None admin] RBAC: Authorizing `identity:get_user(user_id=3147c8ce67f34653b3161cd8b4054108)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:25.581809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5f1bb-3369-4920-bd00-6a60a3222c1b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:25.583389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 576/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:45:25 2022] GET /identity/v3/users/3147c8ce67f34653b3161cd8b4054108 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:25.589016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a03be7-a2d0-4833-bb36-f7271173eb91 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:25.684196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a03be7-a2d0-4833-bb36-f7271173eb91 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:25.711214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:25.716682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c8c51-9701-473d-abbb-527afd57c742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:25.719364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c8c51-9701-473d-abbb-527afd57c742 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:25.719364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c8c51-9701-473d-abbb-527afd57c742 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:25.719364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c8c51-9701-473d-abbb-527afd57c742 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:25.781912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c8c51-9701-473d-abbb-527afd57c742 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:25.783372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c8c51-9701-473d-abbb-527afd57c742 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:25.875007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 607/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:45:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:25.881463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f1bb-3369-4920-bd00-6a60a3222c1b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:25.884258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:25.975732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f1bb-3369-4920-bd00-6a60a3222c1b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:26.008056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4ed25-6fda-4dfc-9418-2530ce93b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:26.008665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4ed25-6fda-4dfc-9418-2530ce93b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:26.008943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4ed25-6fda-4dfc-9418-2530ce93b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:26.009212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4ed25-6fda-4dfc-9418-2530ce93b7b8 None admin] PATH_INFO: `/v3/projects/58ebe920e4f34595a0b1f92d00cec486` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:26.010334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4ed25-6fda-4dfc-9418-2530ce93b7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=58ebe920e4f34595a0b1f92d00cec486)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:26.011739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4ed25-6fda-4dfc-9418-2530ce93b7b8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:26.013336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 577/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:45:25 2022] GET /identity/v3/projects/58ebe920e4f34595a0b1f92d00cec486 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:26.019550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c8c51-9701-473d-abbb-527afd57c742 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:26.047846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:26.114062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c8c51-9701-473d-abbb-527afd57c742 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:26.146355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b724279-ed2c-40eb-a13c-bc5803bf7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:26.146949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b724279-ed2c-40eb-a13c-bc5803bf7032 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:26.147229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b724279-ed2c-40eb-a13c-bc5803bf7032 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:26.147503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b724279-ed2c-40eb-a13c-bc5803bf7032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:26.148215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b724279-ed2c-40eb-a13c-bc5803bf7032 None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=58ebe920e4f34595a0b1f92d00cec486, user.id=3147c8ce67f34653b3161cd8b4054108) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:26.148524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b724279-ed2c-40eb-a13c-bc5803bf7032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:26.149941 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b724279-ed2c-40eb-a13c-bc5803bf7032 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:26.155058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 608/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:45:26 2022] GET /identity/v3/role_assignments?user.id=3147c8ce67f34653b3161cd8b4054108&scope.project.id=58ebe920e4f34595a0b1f92d00cec486&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:28.241209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28d15-b77b-4fd9-9dc7-c83ec7904d70 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:28.241702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28d15-b77b-4fd9-9dc7-c83ec7904d70 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:28.241702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28d15-b77b-4fd9-9dc7-c83ec7904d70 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:28.243018 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 578/1186] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:28.248082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd790898-dcb3-402d-aab0-72fce56ad6c2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:28.248521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd790898-dcb3-402d-aab0-72fce56ad6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:28.248627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd790898-dcb3-402d-aab0-72fce56ad6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:28.267102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dd790898-dcb3-402d-aab0-72fce56ad6c2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:28.268756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dd790898-dcb3-402d-aab0-72fce56ad6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:28.331839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 609/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:45:28.595914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a28d15-b77b-4fd9-9dc7-c83ec7904d70 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:28.664923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:28.694332 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a28d15-b77b-4fd9-9dc7-c83ec7904d70 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:28.726531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a12c6-7a27-4f3e-8e63-70cb017235aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:28.727150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a12c6-7a27-4f3e-8e63-70cb017235aa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:28.727434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a12c6-7a27-4f3e-8e63-70cb017235aa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:28.727709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a12c6-7a27-4f3e-8e63-70cb017235aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:28.737225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a12c6-7a27-4f3e-8e63-70cb017235aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-929a12c6-7a27-4f3e-8e63-70cb017235aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:45:28.742032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:45:28.743125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:45:28.744147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 579/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:45:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:45:28.749097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd790898-dcb3-402d-aab0-72fce56ad6c2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:28.773379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:28.845022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd790898-dcb3-402d-aab0-72fce56ad6c2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:28.877730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9150d-c136-460f-ad7c-65902411e18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:28.878358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9150d-c136-460f-ad7c-65902411e18c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:28.878643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9150d-c136-460f-ad7c-65902411e18c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:28.878917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9150d-c136-460f-ad7c-65902411e18c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:28.879581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9150d-c136-460f-ad7c-65902411e18c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:28.879886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9150d-c136-460f-ad7c-65902411e18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:28.881254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9150d-c136-460f-ad7c-65902411e18c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:28.888948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 610/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:45:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:28.895213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a12c6-7a27-4f3e-8e63-70cb017235aa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:28.991744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a12c6-7a27-4f3e-8e63-70cb017235aa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:29.018692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:29.024360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92ada-d95e-4e0e-9139-2e1ba070b3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:29.024989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92ada-d95e-4e0e-9139-2e1ba070b3fd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:29.025501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92ada-d95e-4e0e-9139-2e1ba070b3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:29.025613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92ada-d95e-4e0e-9139-2e1ba070b3fd None admin] PATH_INFO: `/v3/users/3147c8ce67f34653b3161cd8b4054108` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:29.026682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f92ada-d95e-4e0e-9139-2e1ba070b3fd None admin] RBAC: Authorizing `identity:get_user(user_id=3147c8ce67f34653b3161cd8b4054108)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:29.028113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f92ada-d95e-4e0e-9139-2e1ba070b3fd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:29.029687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 580/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:45:28 2022] GET /identity/v3/users/3147c8ce67f34653b3161cd8b4054108 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:29.035435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9150d-c136-460f-ad7c-65902411e18c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:29.116643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:29.131695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9150d-c136-460f-ad7c-65902411e18c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:29.164414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b83c3c-5de5-49d1-9ac5-a72ba649d3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:29.165034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83c3c-5de5-49d1-9ac5-a72ba649d3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:29.165321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83c3c-5de5-49d1-9ac5-a72ba649d3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:29.165596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83c3c-5de5-49d1-9ac5-a72ba649d3d6 None admin] PATH_INFO: `/v3/projects/58ebe920e4f34595a0b1f92d00cec486` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:29.166743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b83c3c-5de5-49d1-9ac5-a72ba649d3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=58ebe920e4f34595a0b1f92d00cec486)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:29.168200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b83c3c-5de5-49d1-9ac5-a72ba649d3d6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:29.169796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 611/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:45:29 2022] GET /identity/v3/projects/58ebe920e4f34595a0b1f92d00cec486 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:29.176244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92ada-d95e-4e0e-9139-2e1ba070b3fd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:29.270975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92ada-d95e-4e0e-9139-2e1ba070b3fd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:29.302367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc31ee-ed24-4c77-a2cf-81fcea2dfacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:29.303000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc31ee-ed24-4c77-a2cf-81fcea2dfacf None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:29.303287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc31ee-ed24-4c77-a2cf-81fcea2dfacf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:29.303558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc31ee-ed24-4c77-a2cf-81fcea2dfacf None admin] PATH_INFO: `/v3/projects/58ebe920e4f34595a0b1f92d00cec486/users/3147c8ce67f34653b3161cd8b4054108/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:29.305416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc31ee-ed24-4c77-a2cf-81fcea2dfacf None admin] RBAC: Authorizing `identity:create_grant(project_id=58ebe920e4f34595a0b1f92d00cec486, user_id=3147c8ce67f34653b3161cd8b4054108, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:29.306848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc31ee-ed24-4c77-a2cf-81fcea2dfacf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:29.371709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 581/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:45:29 2022] PUT /identity/v3/projects/58ebe920e4f34595a0b1f92d00cec486/users/3147c8ce67f34653b3161cd8b4054108/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:45:31.452275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d612ec7-1fd7-4c01-9922-9cbdec8ccb97 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:31.452803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d612ec7-1fd7-4c01-9922-9cbdec8ccb97 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:31.452803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d612ec7-1fd7-4c01-9922-9cbdec8ccb97 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:31.454209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 612/1193] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:31.459462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19109086-95ba-4436-8830-28dad6bc0f36 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:31.459830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19109086-95ba-4436-8830-28dad6bc0f36 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:31.460013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19109086-95ba-4436-8830-28dad6bc0f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:31.477908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-19109086-95ba-4436-8830-28dad6bc0f36 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:31.479116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-19109086-95ba-4436-8830-28dad6bc0f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:31.529985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:31.542539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 582/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:45:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:45:31.809833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d612ec7-1fd7-4c01-9922-9cbdec8ccb97 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:31.907133 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d612ec7-1fd7-4c01-9922-9cbdec8ccb97 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:31.940670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3f23d-1d9f-449e-9b45-ec5510cd584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:31.941309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3f23d-1d9f-449e-9b45-ec5510cd584f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:31.941591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3f23d-1d9f-449e-9b45-ec5510cd584f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:31.941863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3f23d-1d9f-449e-9b45-ec5510cd584f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:31.951780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3f23d-1d9f-449e-9b45-ec5510cd584f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e2e3f23d-1d9f-449e-9b45-ec5510cd584f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:45:31.956580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:45:31.957636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:45:31.958752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 613/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:45:31.963609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19109086-95ba-4436-8830-28dad6bc0f36 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:32.057989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19109086-95ba-4436-8830-28dad6bc0f36 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:32.090543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473382cd-7211-47d9-9fd2-36034020d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:32.091083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473382cd-7211-47d9-9fd2-36034020d139 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:32.091365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473382cd-7211-47d9-9fd2-36034020d139 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:32.091640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473382cd-7211-47d9-9fd2-36034020d139 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:32.092301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473382cd-7211-47d9-9fd2-36034020d139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:32.092607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473382cd-7211-47d9-9fd2-36034020d139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:32.093963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473382cd-7211-47d9-9fd2-36034020d139 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:32.102538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 583/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:45:32.108372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3f23d-1d9f-449e-9b45-ec5510cd584f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:32.123871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:32.202883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3f23d-1d9f-449e-9b45-ec5510cd584f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:32.236098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f48e-d4c8-4fad-bbe9-d30173d1dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:32.236721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f48e-d4c8-4fad-bbe9-d30173d1dc03 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:32.236999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f48e-d4c8-4fad-bbe9-d30173d1dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:32.237271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f48e-d4c8-4fad-bbe9-d30173d1dc03 None admin] PATH_INFO: `/v3/users/3147c8ce67f34653b3161cd8b4054108` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:32.238398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3f48e-d4c8-4fad-bbe9-d30173d1dc03 None admin] RBAC: Authorizing `identity:get_user(user_id=3147c8ce67f34653b3161cd8b4054108)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:32.239822 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3f48e-d4c8-4fad-bbe9-d30173d1dc03 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:32.241363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 614/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Oct 4 08:45:32 2022] GET /identity/v3/users/3147c8ce67f34653b3161cd8b4054108 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:32.247034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473382cd-7211-47d9-9fd2-36034020d139 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:32.296613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:32.344032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473382cd-7211-47d9-9fd2-36034020d139 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:32.376225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d15b5-b50b-44dd-a097-f510d020470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:32.376824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d15b5-b50b-44dd-a097-f510d020470b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:32.377622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d15b5-b50b-44dd-a097-f510d020470b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:32.377892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d15b5-b50b-44dd-a097-f510d020470b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:32.440586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d15b5-b50b-44dd-a097-f510d020470b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:32.442017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d15b5-b50b-44dd-a097-f510d020470b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:32.486905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:32.535573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 584/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:45:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:45:32.541583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f48e-d4c8-4fad-bbe9-d30173d1dc03 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:32.619129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:32.636708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f48e-d4c8-4fad-bbe9-d30173d1dc03 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:32.669512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c355ce-9317-4992-af63-f055c757f07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:32.670157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c355ce-9317-4992-af63-f055c757f07a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:32.670439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c355ce-9317-4992-af63-f055c757f07a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:32.670712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c355ce-9317-4992-af63-f055c757f07a None admin] PATH_INFO: `/v3/projects/58ebe920e4f34595a0b1f92d00cec486` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:32.671821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c355ce-9317-4992-af63-f055c757f07a None admin] RBAC: Authorizing `identity:get_project(project_id=58ebe920e4f34595a0b1f92d00cec486)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:32.673242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c355ce-9317-4992-af63-f055c757f07a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:32.674922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 615/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Oct 4 08:45:32 2022] GET /identity/v3/projects/58ebe920e4f34595a0b1f92d00cec486 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:32.681118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d15b5-b50b-44dd-a097-f510d020470b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:32.775833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d15b5-b50b-44dd-a097-f510d020470b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:32.807922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3a555-a2bb-4589-b9fd-ed9467864fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:32.808507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3a555-a2bb-4589-b9fd-ed9467864fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:32.808790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3a555-a2bb-4589-b9fd-ed9467864fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:32.809061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3a555-a2bb-4589-b9fd-ed9467864fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:32.809778 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3a555-a2bb-4589-b9fd-ed9467864fb3 None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=58ebe920e4f34595a0b1f92d00cec486, user.id=3147c8ce67f34653b3161cd8b4054108) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:45:32.810112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3a555-a2bb-4589-b9fd-ed9467864fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:32.811528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3a555-a2bb-4589-b9fd-ed9467864fb3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:32.817637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 585/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:45:32 2022] GET /identity/v3/role_assignments?user.id=3147c8ce67f34653b3161cd8b4054108&scope.project.id=58ebe920e4f34595a0b1f92d00cec486&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:45:42.665431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=25 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:42.814789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:43.980525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7a0e4-58ef-4d1f-930a-23ec66087181 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:43.981067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7a0e4-58ef-4d1f-930a-23ec66087181 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:43.981067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7a0e4-58ef-4d1f-930a-23ec66087181 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:43.982505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 616/1201] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:43.987666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec616b3-afee-4129-a386-794357fd61b6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:43.988173 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec616b3-afee-4129-a386-794357fd61b6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:43.988277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec616b3-afee-4129-a386-794357fd61b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:44.005992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5ec616b3-afee-4129-a386-794357fd61b6 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:44.007220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ec616b3-afee-4129-a386-794357fd61b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:44.074676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 586/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:46:44.344610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7a0e4-58ef-4d1f-930a-23ec66087181 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:44.444359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7a0e4-58ef-4d1f-930a-23ec66087181 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:44.480888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4b963-fc1a-41d4-bf6e-45077c3eb7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:44.481511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4b963-fc1a-41d4-bf6e-45077c3eb7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:44.481819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4b963-fc1a-41d4-bf6e-45077c3eb7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:44.482105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4b963-fc1a-41d4-bf6e-45077c3eb7d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:44.492083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4b963-fc1a-41d4-bf6e-45077c3eb7d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:44.493564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4b963-fc1a-41d4-bf6e-45077c3eb7d6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-74b4b963-fc1a-41d4-bf6e-45077c3eb7d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:46:44.508351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:44.509554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:46:44.510722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:46:44.510722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:44.510722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:46:44.510722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 617/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:46:44.515671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec616b3-afee-4129-a386-794357fd61b6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:44.613870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec616b3-afee-4129-a386-794357fd61b6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:44.641666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:44.647230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f358f9-b73c-4f3b-bd7f-7053da8d1552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:44.648649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f358f9-b73c-4f3b-bd7f-7053da8d1552 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:44.648649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f358f9-b73c-4f3b-bd7f-7053da8d1552 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:44.648649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f358f9-b73c-4f3b-bd7f-7053da8d1552 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:44.649046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f358f9-b73c-4f3b-bd7f-7053da8d1552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:44.649345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f358f9-b73c-4f3b-bd7f-7053da8d1552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:44.650749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f358f9-b73c-4f3b-bd7f-7053da8d1552 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:44.663482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 587/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:44.669246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4b963-fc1a-41d4-bf6e-45077c3eb7d6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:44.720470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:44.767585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4b963-fc1a-41d4-bf6e-45077c3eb7d6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:44.800495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b09d4f-f89d-4b2c-a8ca-b3403523d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:44.801092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b09d4f-f89d-4b2c-a8ca-b3403523d2f9 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:44.801369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b09d4f-f89d-4b2c-a8ca-b3403523d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:44.801637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b09d4f-f89d-4b2c-a8ca-b3403523d2f9 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:44.802311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b09d4f-f89d-4b2c-a8ca-b3403523d2f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:44.803744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b09d4f-f89d-4b2c-a8ca-b3403523d2f9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:44.873147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 618/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Oct 4 08:46:44 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:46:47.023984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6946-030a-451d-a0bf-bb0cf16652de None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:47.024520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6946-030a-451d-a0bf-bb0cf16652de None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:47.024619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6946-030a-451d-a0bf-bb0cf16652de None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:47.026036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 588/1206] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:47.031411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c6b7f-49fe-44d4-8d7a-c3303598469a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:47.031411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c6b7f-49fe-44d4-8d7a-c3303598469a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:47.031880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c6b7f-49fe-44d4-8d7a-c3303598469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:47.050017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-175c6b7f-49fe-44d4-8d7a-c3303598469a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:47.051230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-175c6b7f-49fe-44d4-8d7a-c3303598469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:47.115559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 619/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:46:47.383228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d6946-030a-451d-a0bf-bb0cf16652de None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:47.481301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d6946-030a-451d-a0bf-bb0cf16652de None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:47.513540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff05f88-7d47-464d-9b82-5cdf454bed3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:47.514245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff05f88-7d47-464d-9b82-5cdf454bed3a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:47.514528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff05f88-7d47-464d-9b82-5cdf454bed3a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:47.514803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff05f88-7d47-464d-9b82-5cdf454bed3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:47.524914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff05f88-7d47-464d-9b82-5cdf454bed3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6ff05f88-7d47-464d-9b82-5cdf454bed3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:46:47.529603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:47.530759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:47.531988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 589/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:46:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:47.536808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c6b7f-49fe-44d4-8d7a-c3303598469a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:47.575017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:47.633999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c6b7f-49fe-44d4-8d7a-c3303598469a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:47.665511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d0134-a7dc-47df-8cc2-f49623a5390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:47.668844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0134-a7dc-47df-8cc2-f49623a5390c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:47.668844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0134-a7dc-47df-8cc2-f49623a5390c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:47.668844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0134-a7dc-47df-8cc2-f49623a5390c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:47.668844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d0134-a7dc-47df-8cc2-f49623a5390c None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:47.668844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d0134-a7dc-47df-8cc2-f49623a5390c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:47.669292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d0134-a7dc-47df-8cc2-f49623a5390c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:47.676964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 620/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:46:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:47.682867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff05f88-7d47-464d-9b82-5cdf454bed3a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:47.732466 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:47.779912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff05f88-7d47-464d-9b82-5cdf454bed3a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:47.813236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b86b-0778-4062-b0fe-e71046bbcfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:47.813868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b86b-0778-4062-b0fe-e71046bbcfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:47.814167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b86b-0778-4062-b0fe-e71046bbcfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:47.814444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b86b-0778-4062-b0fe-e71046bbcfa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:47.824809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b86b-0778-4062-b0fe-e71046bbcfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:47.826276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b86b-0778-4062-b0fe-e71046bbcfa4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fb15b86b-0778-4062-b0fe-e71046bbcfa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:46:47.840740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:47.841905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:46:47.842903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:46:47.842903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:47.842903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:47.842903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 590/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:47.847922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d0134-a7dc-47df-8cc2-f49623a5390c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:47.946628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:47.949551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d0134-a7dc-47df-8cc2-f49623a5390c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:47.983469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a5e46-2dd5-4e79-81fa-9c3b6b796289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:47.984073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a5e46-2dd5-4e79-81fa-9c3b6b796289 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:47.984358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a5e46-2dd5-4e79-81fa-9c3b6b796289 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:47.984660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a5e46-2dd5-4e79-81fa-9c3b6b796289 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:47.985305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a5e46-2dd5-4e79-81fa-9c3b6b796289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:47.985611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a5e46-2dd5-4e79-81fa-9c3b6b796289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:47.987554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a5e46-2dd5-4e79-81fa-9c3b6b796289 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:47.998472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 621/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:48.005305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b86b-0778-4062-b0fe-e71046bbcfa4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:48.104760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b86b-0778-4062-b0fe-e71046bbcfa4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:48.106348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:48.137960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f86bd9-58e9-47b8-b3a3-72cd8e366948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:48.138612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f86bd9-58e9-47b8-b3a3-72cd8e366948 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:48.138972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f86bd9-58e9-47b8-b3a3-72cd8e366948 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:48.139246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f86bd9-58e9-47b8-b3a3-72cd8e366948 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:48.146103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f86bd9-58e9-47b8-b3a3-72cd8e366948 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:48.147531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f86bd9-58e9-47b8-b3a3-72cd8e366948 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d1f86bd9-58e9-47b8-b3a3-72cd8e366948 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:46:48.160110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:48.161352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:48.162600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 591/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:48.167165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a5e46-2dd5-4e79-81fa-9c3b6b796289 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:48.265343 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a5e46-2dd5-4e79-81fa-9c3b6b796289 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:48.299643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d5784-8498-4a02-879c-04a1ff01e7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:48.300739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d5784-8498-4a02-879c-04a1ff01e7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:48.301019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d5784-8498-4a02-879c-04a1ff01e7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:48.301294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d5784-8498-4a02-879c-04a1ff01e7f9 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:48.302017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d5784-8498-4a02-879c-04a1ff01e7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:48.302425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d5784-8498-4a02-879c-04a1ff01e7f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:48.307261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d5784-8498-4a02-879c-04a1ff01e7f9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:48.321017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 622/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 08:46:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:46:48.326873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f86bd9-58e9-47b8-b3a3-72cd8e366948 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:48.425080 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f86bd9-58e9-47b8-b3a3-72cd8e366948 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:48.457606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2137a-e269-416a-94eb-5905753310ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:48.458239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2137a-e269-416a-94eb-5905753310ea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:48.458521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2137a-e269-416a-94eb-5905753310ea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:48.458793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2137a-e269-416a-94eb-5905753310ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:48.487968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:48.523987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2137a-e269-416a-94eb-5905753310ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:48.525377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2137a-e269-416a-94eb-5905753310ea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:48.620462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 592/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:46:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:46:48.626520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d5784-8498-4a02-879c-04a1ff01e7f9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:48.645244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:48.723025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d5784-8498-4a02-879c-04a1ff01e7f9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:48.757831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ebe81-5f6e-4010-a75a-8495800cc405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:48.758496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ebe81-5f6e-4010-a75a-8495800cc405 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:48.758774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ebe81-5f6e-4010-a75a-8495800cc405 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:48.759043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ebe81-5f6e-4010-a75a-8495800cc405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:48.768578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ebe81-5f6e-4010-a75a-8495800cc405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:48.770021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ebe81-5f6e-4010-a75a-8495800cc405 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-103ebe81-5f6e-4010-a75a-8495800cc405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:46:48.784700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:48.785791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:46:48.786902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:46:48.786902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:48.786902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:46:48.786902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 623/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:48.791580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2137a-e269-416a-94eb-5905753310ea None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:48.853317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:48.891527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2137a-e269-416a-94eb-5905753310ea None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:48.925469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf7a1c-75c2-4146-91fb-1b2c05b4d9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:48.926075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf7a1c-75c2-4146-91fb-1b2c05b4d9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:48.926387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf7a1c-75c2-4146-91fb-1b2c05b4d9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:48.926660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf7a1c-75c2-4146-91fb-1b2c05b4d9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:48.927421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf7a1c-75c2-4146-91fb-1b2c05b4d9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:48.927730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf7a1c-75c2-4146-91fb-1b2c05b4d9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:48.929101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf7a1c-75c2-4146-91fb-1b2c05b4d9d2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:48.941255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 593/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:48.950225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ebe81-5f6e-4010-a75a-8495800cc405 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:49.014320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:49.043907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ebe81-5f6e-4010-a75a-8495800cc405 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:49.075904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d5127-b17c-43f7-a21f-0fa0e6606304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:49.076523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d5127-b17c-43f7-a21f-0fa0e6606304 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:49.076805 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d5127-b17c-43f7-a21f-0fa0e6606304 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:49.077074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d5127-b17c-43f7-a21f-0fa0e6606304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:49.083367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d5127-b17c-43f7-a21f-0fa0e6606304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:49.084912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d5127-b17c-43f7-a21f-0fa0e6606304 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b93d5127-b17c-43f7-a21f-0fa0e6606304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:46:49.097045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:49.097943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:49.098926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:46:49.098926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:46:49.098926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:46:49.098926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:46:49.098926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:46:49.098926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:46:49.098926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:46:49.098926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:46:49.098926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 624/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:49.104265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf7a1c-75c2-4146-91fb-1b2c05b4d9d2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:49.202787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf7a1c-75c2-4146-91fb-1b2c05b4d9d2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:49.226336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:49.237352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c82ce-5450-493a-8306-7c815dcdc35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:49.237955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c82ce-5450-493a-8306-7c815dcdc35a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:49.238277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c82ce-5450-493a-8306-7c815dcdc35a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:49.238554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c82ce-5450-493a-8306-7c815dcdc35a None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:49.239247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c82ce-5450-493a-8306-7c815dcdc35a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:49.239554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c82ce-5450-493a-8306-7c815dcdc35a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:49.241015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c82ce-5450-493a-8306-7c815dcdc35a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:49.252101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 594/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:46:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:49.258226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d5127-b17c-43f7-a21f-0fa0e6606304 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:49.355610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d5127-b17c-43f7-a21f-0fa0e6606304 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:49.382039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:49.387625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c043c-5b7b-4c8b-a51d-7ce5744febfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:49.388217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c043c-5b7b-4c8b-a51d-7ce5744febfd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:49.388496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c043c-5b7b-4c8b-a51d-7ce5744febfd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:49.388765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c043c-5b7b-4c8b-a51d-7ce5744febfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:49.389482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c043c-5b7b-4c8b-a51d-7ce5744febfd None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=efba357340ac47dca0b1742d4e04fd7c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:49.389789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c043c-5b7b-4c8b-a51d-7ce5744febfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:49.391228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c043c-5b7b-4c8b-a51d-7ce5744febfd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:49.396804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 625/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:46:49 2022] GET /identity/v3/role_assignments?user.id=efba357340ac47dca0b1742d4e04fd7c&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:51.531679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717488fe-1cdf-40b2-96dd-39bf8dfc91a8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:51.532233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717488fe-1cdf-40b2-96dd-39bf8dfc91a8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:51.532233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717488fe-1cdf-40b2-96dd-39bf8dfc91a8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:51.533559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 595/1220] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:51.538797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74615713-a2c9-42dc-823f-36a211d28100 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:51.539217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74615713-a2c9-42dc-823f-36a211d28100 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:51.539347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74615713-a2c9-42dc-823f-36a211d28100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:51.557596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-74615713-a2c9-42dc-823f-36a211d28100 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:51.558803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-74615713-a2c9-42dc-823f-36a211d28100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:51.624167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 626/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:46:51.894922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717488fe-1cdf-40b2-96dd-39bf8dfc91a8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:51.995728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717488fe-1cdf-40b2-96dd-39bf8dfc91a8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:52.027678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaada5f-f89e-432c-9e48-c0cdc8b1508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:52.028299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaada5f-f89e-432c-9e48-c0cdc8b1508a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:52.028580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaada5f-f89e-432c-9e48-c0cdc8b1508a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:52.028852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaada5f-f89e-432c-9e48-c0cdc8b1508a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:52.039518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaada5f-f89e-432c-9e48-c0cdc8b1508a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-cbaada5f-f89e-432c-9e48-c0cdc8b1508a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:46:52.044399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:52.045461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:52.046439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 596/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:46:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:52.052605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74615713-a2c9-42dc-823f-36a211d28100 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:52.149707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74615713-a2c9-42dc-823f-36a211d28100 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:52.172424 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:52.182559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91eb95-6a6d-4951-ac7a-b5d633269f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:52.183156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91eb95-6a6d-4951-ac7a-b5d633269f31 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:52.183433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91eb95-6a6d-4951-ac7a-b5d633269f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:52.183706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91eb95-6a6d-4951-ac7a-b5d633269f31 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:52.184368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91eb95-6a6d-4951-ac7a-b5d633269f31 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:52.184663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91eb95-6a6d-4951-ac7a-b5d633269f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:52.186015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91eb95-6a6d-4951-ac7a-b5d633269f31 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:52.193499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 627/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:46:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:52.199579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaada5f-f89e-432c-9e48-c0cdc8b1508a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:52.243152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:52.297995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaada5f-f89e-432c-9e48-c0cdc8b1508a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:52.329491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca336057-ec9f-46a4-9584-e1d1acf18cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:52.330130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca336057-ec9f-46a4-9584-e1d1acf18cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:52.330417 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca336057-ec9f-46a4-9584-e1d1acf18cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:52.331183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca336057-ec9f-46a4-9584-e1d1acf18cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:52.342064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca336057-ec9f-46a4-9584-e1d1acf18cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:52.343548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca336057-ec9f-46a4-9584-e1d1acf18cd2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ca336057-ec9f-46a4-9584-e1d1acf18cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:46:52.358341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:52.359475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:46:52.360586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:46:52.360586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:52.360586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:52.360586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 597/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:52.365282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91eb95-6a6d-4951-ac7a-b5d633269f31 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:52.465078 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91eb95-6a6d-4951-ac7a-b5d633269f31 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:52.497666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727ecec-058c-4a5c-be2b-97ef830ea457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:52.498326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727ecec-058c-4a5c-be2b-97ef830ea457 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:52.498650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727ecec-058c-4a5c-be2b-97ef830ea457 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:52.498928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727ecec-058c-4a5c-be2b-97ef830ea457 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:52.499562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727ecec-058c-4a5c-be2b-97ef830ea457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:52.499864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727ecec-058c-4a5c-be2b-97ef830ea457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:52.501239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727ecec-058c-4a5c-be2b-97ef830ea457 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:52.513327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 628/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:52.519780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca336057-ec9f-46a4-9584-e1d1acf18cd2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:52.610625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:52.617667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca336057-ec9f-46a4-9584-e1d1acf18cd2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:52.650689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a98e7b-0b8f-49e0-9a5d-f75cab2daab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:52.651313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a98e7b-0b8f-49e0-9a5d-f75cab2daab3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:52.651596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a98e7b-0b8f-49e0-9a5d-f75cab2daab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:52.651870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a98e7b-0b8f-49e0-9a5d-f75cab2daab3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:52.658528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a98e7b-0b8f-49e0-9a5d-f75cab2daab3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:52.660445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a98e7b-0b8f-49e0-9a5d-f75cab2daab3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b9a98e7b-0b8f-49e0-9a5d-f75cab2daab3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:46:52.671682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:52.672772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:52.674063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 598/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:52.678906 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727ecec-058c-4a5c-be2b-97ef830ea457 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:52.726281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:52.778429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727ecec-058c-4a5c-be2b-97ef830ea457 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:52.809925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66d26d-9426-4812-8301-421f343e7c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:52.810559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66d26d-9426-4812-8301-421f343e7c97 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:52.810837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66d26d-9426-4812-8301-421f343e7c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:52.811108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66d26d-9426-4812-8301-421f343e7c97 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:52.811819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66d26d-9426-4812-8301-421f343e7c97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:52.812122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66d26d-9426-4812-8301-421f343e7c97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:52.813585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66d26d-9426-4812-8301-421f343e7c97 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:52.830231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 629/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 08:46:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:52.837004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a98e7b-0b8f-49e0-9a5d-f75cab2daab3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:52.934587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a98e7b-0b8f-49e0-9a5d-f75cab2daab3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:52.967535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb4dfe-7b13-468b-9f02-035f2df80dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:52.968157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb4dfe-7b13-468b-9f02-035f2df80dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:52.968432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb4dfe-7b13-468b-9f02-035f2df80dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:52.968699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb4dfe-7b13-468b-9f02-035f2df80dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:52.979032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb4dfe-7b13-468b-9f02-035f2df80dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:52.980400 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb4dfe-7b13-468b-9f02-035f2df80dc4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0bdb4dfe-7b13-468b-9f02-035f2df80dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:46:52.994363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:52.995409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:46:52.996385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:46:52.996385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:52.996385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:52.996385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 599/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:53.001322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66d26d-9426-4812-8301-421f343e7c97 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:53.103435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66d26d-9426-4812-8301-421f343e7c97 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:53.105758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:53.136885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ba77b-927f-44a1-9a73-c54d9ea5a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:53.137482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ba77b-927f-44a1-9a73-c54d9ea5a50d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:53.137758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ba77b-927f-44a1-9a73-c54d9ea5a50d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:53.138026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ba77b-927f-44a1-9a73-c54d9ea5a50d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:53.138750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ba77b-927f-44a1-9a73-c54d9ea5a50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:53.139087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ba77b-927f-44a1-9a73-c54d9ea5a50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:53.140431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ba77b-927f-44a1-9a73-c54d9ea5a50d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:53.151430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 630/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:53.157278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb4dfe-7b13-468b-9f02-035f2df80dc4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:53.167702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:53.255131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb4dfe-7b13-468b-9f02-035f2df80dc4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:53.287910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70424c7-2281-40f2-861b-db9d60213cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:53.288529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70424c7-2281-40f2-861b-db9d60213cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:53.288808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70424c7-2281-40f2-861b-db9d60213cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:53.289080 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70424c7-2281-40f2-861b-db9d60213cb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:53.295606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70424c7-2281-40f2-861b-db9d60213cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:53.297036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70424c7-2281-40f2-861b-db9d60213cb7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a70424c7-2281-40f2-861b-db9d60213cb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:46:53.308775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:53.309678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:53.310727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:46:53.310727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:46:53.310727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:46:53.310727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:46:53.310727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:46:53.310727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:46:53.310727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:46:53.310727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:53.310727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 600/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:46:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:53.315833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ba77b-927f-44a1-9a73-c54d9ea5a50d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:53.414642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ba77b-927f-44a1-9a73-c54d9ea5a50d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:53.447745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d808f0-fbe9-4bc1-bd43-f2d4c0c61870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:53.448350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d808f0-fbe9-4bc1-bd43-f2d4c0c61870 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:53.448636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d808f0-fbe9-4bc1-bd43-f2d4c0c61870 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:53.448912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d808f0-fbe9-4bc1-bd43-f2d4c0c61870 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:53.449606 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d808f0-fbe9-4bc1-bd43-f2d4c0c61870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:53.449921 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d808f0-fbe9-4bc1-bd43-f2d4c0c61870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:53.451427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d808f0-fbe9-4bc1-bd43-f2d4c0c61870 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:53.463236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 631/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:46:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:53.469376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70424c7-2281-40f2-861b-db9d60213cb7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:53.533318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:53.567695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70424c7-2281-40f2-861b-db9d60213cb7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:53.601211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a17a4-482e-4f91-a6b0-cdb87f45ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:53.601875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a17a4-482e-4f91-a6b0-cdb87f45ad22 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:53.602189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a17a4-482e-4f91-a6b0-cdb87f45ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:53.602469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a17a4-482e-4f91-a6b0-cdb87f45ad22 None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/efba357340ac47dca0b1742d4e04fd7c/roles/a53d956761a64b18a7d7e76cbef98222` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:53.616902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a17a4-482e-4f91-a6b0-cdb87f45ad22 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=efba357340ac47dca0b1742d4e04fd7c, role_id=a53d956761a64b18a7d7e76cbef98222)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:53.618355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a17a4-482e-4f91-a6b0-cdb87f45ad22 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:53.699240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 601/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:46:53 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/efba357340ac47dca0b1742d4e04fd7c/roles/a53d956761a64b18a7d7e76cbef98222 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:46:55.824950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d338-c0e3-476f-aee3-06379e20ebf1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:55.825514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d338-c0e3-476f-aee3-06379e20ebf1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:55.825514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d338-c0e3-476f-aee3-06379e20ebf1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:55.826885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 632/1233] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:55.832979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20264b1-edc7-4670-80dc-7829b23c2ad1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:55.841435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20264b1-edc7-4670-80dc-7829b23c2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:55.841435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20264b1-edc7-4670-80dc-7829b23c2ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:55.851364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c20264b1-edc7-4670-80dc-7829b23c2ad1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:55.852532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c20264b1-edc7-4670-80dc-7829b23c2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:55.918196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 602/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:46:56.186326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d338-c0e3-476f-aee3-06379e20ebf1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:56.211996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:56.287047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d338-c0e3-476f-aee3-06379e20ebf1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:56.320981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4e8f1-2ee9-4cfb-9e04-d9b75f8798d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:56.321599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4e8f1-2ee9-4cfb-9e04-d9b75f8798d5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:56.321883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4e8f1-2ee9-4cfb-9e04-d9b75f8798d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:56.322186 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4e8f1-2ee9-4cfb-9e04-d9b75f8798d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:56.332031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4e8f1-2ee9-4cfb-9e04-d9b75f8798d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2fd4e8f1-2ee9-4cfb-9e04-d9b75f8798d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:46:56.336985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:56.337998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:46:56.339167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 633/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Oct 4 08:46:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:56.344083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20264b1-edc7-4670-80dc-7829b23c2ad1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:56.390120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:56.439765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20264b1-edc7-4670-80dc-7829b23c2ad1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:56.472410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b39f84-38ea-44d5-bfce-70b0689d984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:56.473024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39f84-38ea-44d5-bfce-70b0689d984d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:56.473300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39f84-38ea-44d5-bfce-70b0689d984d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:56.473573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b39f84-38ea-44d5-bfce-70b0689d984d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:56.474280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b39f84-38ea-44d5-bfce-70b0689d984d None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:56.474575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b39f84-38ea-44d5-bfce-70b0689d984d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:56.475998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b39f84-38ea-44d5-bfce-70b0689d984d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:56.483954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 603/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Oct 4 08:46:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:56.490725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4e8f1-2ee9-4cfb-9e04-d9b75f8798d5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:56.574548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:56.589502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4e8f1-2ee9-4cfb-9e04-d9b75f8798d5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:56.623761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085a69-77c0-4729-ac34-d401cad9f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:56.624375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085a69-77c0-4729-ac34-d401cad9f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:56.624656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085a69-77c0-4729-ac34-d401cad9f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:56.624928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085a69-77c0-4729-ac34-d401cad9f5d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:56.634626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c085a69-77c0-4729-ac34-d401cad9f5d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:56.636094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c085a69-77c0-4729-ac34-d401cad9f5d9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4c085a69-77c0-4729-ac34-d401cad9f5d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:46:56.651175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:56.652317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:46:56.653416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:46:56.653416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:56.653416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:46:56.653416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 634/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:56.660147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b39f84-38ea-44d5-bfce-70b0689d984d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:56.759782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b39f84-38ea-44d5-bfce-70b0689d984d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:56.769126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:56.793731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6891f-2b02-497b-9682-9126a26f2de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:56.794369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6891f-2b02-497b-9682-9126a26f2de1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:56.794657 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6891f-2b02-497b-9682-9126a26f2de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:56.794932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6891f-2b02-497b-9682-9126a26f2de1 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:56.795638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6891f-2b02-497b-9682-9126a26f2de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:56.795942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6891f-2b02-497b-9682-9126a26f2de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:56.797331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6891f-2b02-497b-9682-9126a26f2de1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:56.809370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 604/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:56.815055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085a69-77c0-4729-ac34-d401cad9f5d9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:56.913850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085a69-77c0-4729-ac34-d401cad9f5d9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:56.947758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebab457-daf1-403a-bf4b-0f65094a8bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:56.952901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebab457-daf1-403a-bf4b-0f65094a8bab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:56.952901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebab457-daf1-403a-bf4b-0f65094a8bab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:56.952901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebab457-daf1-403a-bf4b-0f65094a8bab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:56.952901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:56.956857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebab457-daf1-403a-bf4b-0f65094a8bab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:56.958308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebab457-daf1-403a-bf4b-0f65094a8bab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7ebab457-daf1-403a-bf4b-0f65094a8bab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:46:56.970488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:56.976915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:46:56.978056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 635/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:56.978766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6891f-2b02-497b-9682-9126a26f2de1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:57.074011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6891f-2b02-497b-9682-9126a26f2de1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:57.107814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bc993-5962-455f-be01-3406a9bc5596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:57.108416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc993-5962-455f-be01-3406a9bc5596 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:57.108691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc993-5962-455f-be01-3406a9bc5596 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:57.108997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc993-5962-455f-be01-3406a9bc5596 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:57.109766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bc993-5962-455f-be01-3406a9bc5596 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:57.110068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bc993-5962-455f-be01-3406a9bc5596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:57.111532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bc993-5962-455f-be01-3406a9bc5596 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:57.128508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 605/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 08:46:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:57.134376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebab457-daf1-403a-bf4b-0f65094a8bab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:57.234492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebab457-daf1-403a-bf4b-0f65094a8bab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:57.266255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b6f5a-e834-4f20-adb5-a2ea368ea1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:57.266858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b6f5a-e834-4f20-adb5-a2ea368ea1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:57.267133 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b6f5a-e834-4f20-adb5-a2ea368ea1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:57.267404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b6f5a-e834-4f20-adb5-a2ea368ea1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:57.325480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:57.332174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b6f5a-e834-4f20-adb5-a2ea368ea1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:57.333609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b6f5a-e834-4f20-adb5-a2ea368ea1f6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:57.426934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 636/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:46:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:46:57.432716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bc993-5962-455f-be01-3406a9bc5596 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:57.459851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:57.529186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bc993-5962-455f-be01-3406a9bc5596 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:57.561830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd419e-71ba-475a-a02a-7446dd1c8d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:57.562476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd419e-71ba-475a-a02a-7446dd1c8d32 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:57.562754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd419e-71ba-475a-a02a-7446dd1c8d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:57.563022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd419e-71ba-475a-a02a-7446dd1c8d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:57.573207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd419e-71ba-475a-a02a-7446dd1c8d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:57.574673 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd419e-71ba-475a-a02a-7446dd1c8d32 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-58cd419e-71ba-475a-a02a-7446dd1c8d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:46:57.588830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:57.589924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:46:57.591059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:46:57.591059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:46:57.591059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:57.591059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 606/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:57.595855 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b6f5a-e834-4f20-adb5-a2ea368ea1f6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:57.687062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:57.693444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b6f5a-e834-4f20-adb5-a2ea368ea1f6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:57.725894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f5e58-219b-4fe8-957f-11a21e92ffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:57.726532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f5e58-219b-4fe8-957f-11a21e92ffa9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:57.726816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f5e58-219b-4fe8-957f-11a21e92ffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:57.727091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f5e58-219b-4fe8-957f-11a21e92ffa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:57.727731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f5e58-219b-4fe8-957f-11a21e92ffa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:57.728043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f5e58-219b-4fe8-957f-11a21e92ffa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:57.729441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f5e58-219b-4fe8-957f-11a21e92ffa9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:57.741052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 637/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:57.746864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd419e-71ba-475a-a02a-7446dd1c8d32 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:57.823110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:57.843393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd419e-71ba-475a-a02a-7446dd1c8d32 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:57.875655 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281bc5-63f9-4292-b0c1-771cea0be7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:57.876269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281bc5-63f9-4292-b0c1-771cea0be7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:57.876548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281bc5-63f9-4292-b0c1-771cea0be7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:57.876820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281bc5-63f9-4292-b0c1-771cea0be7e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:57.883106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b281bc5-63f9-4292-b0c1-771cea0be7e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:57.884529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b281bc5-63f9-4292-b0c1-771cea0be7e1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0b281bc5-63f9-4292-b0c1-771cea0be7e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:46:57.895608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:46:57.902436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:46:57.903506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:46:57.903506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:46:57.903506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:46:57.903506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:46:57.903506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:46:57.903506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:46:57.903506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:46:57.903506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:46:57.903506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 607/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:46:57.904279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f5e58-219b-4fe8-957f-11a21e92ffa9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:58.002459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f5e58-219b-4fe8-957f-11a21e92ffa9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:58.035320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90642d-65ce-47bc-aba5-9fa0048194a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:58.035924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90642d-65ce-47bc-aba5-9fa0048194a8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:58.036209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90642d-65ce-47bc-aba5-9fa0048194a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:58.036489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90642d-65ce-47bc-aba5-9fa0048194a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:58.037179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90642d-65ce-47bc-aba5-9fa0048194a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:58.037521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90642d-65ce-47bc-aba5-9fa0048194a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:58.039047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90642d-65ce-47bc-aba5-9fa0048194a8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:58.051322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 638/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:46:58.057390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281bc5-63f9-4292-b0c1-771cea0be7e1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:58.155523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281bc5-63f9-4292-b0c1-771cea0be7e1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:58.188179 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec6c2e-f0e5-4848-8c7c-0601b8e4580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:58.188773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec6c2e-f0e5-4848-8c7c-0601b8e4580b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:58.189052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec6c2e-f0e5-4848-8c7c-0601b8e4580b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:58.189373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec6c2e-f0e5-4848-8c7c-0601b8e4580b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:58.190113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec6c2e-f0e5-4848-8c7c-0601b8e4580b None admin] RBAC: Adding query filter params (role.id=a53d956761a64b18a7d7e76cbef98222, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=efba357340ac47dca0b1742d4e04fd7c) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:46:58.190425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec6c2e-f0e5-4848-8c7c-0601b8e4580b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:58.191886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec6c2e-f0e5-4848-8c7c-0601b8e4580b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:58.197456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 608/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:46:58 2022] GET /identity/v3/role_assignments?user.id=efba357340ac47dca0b1742d4e04fd7c&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=a53d956761a64b18a7d7e76cbef98222 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:00.374406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931aa8-f9c5-459f-adc6-fbce39d25a19 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:00.374938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931aa8-f9c5-459f-adc6-fbce39d25a19 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:00.374938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7931aa8-f9c5-459f-adc6-fbce39d25a19 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:00.376322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 639/1247] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:00.382522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b6320-a2d5-449c-9837-9005d0416ec0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:00.382952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b6320-a2d5-449c-9837-9005d0416ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:00.383062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b6320-a2d5-449c-9837-9005d0416ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:00.389354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:00.402010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3a6b6320-a2d5-449c-9837-9005d0416ec0 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:00.403224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3a6b6320-a2d5-449c-9837-9005d0416ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:00.466842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 609/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:47:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:47:00.733892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7931aa8-f9c5-459f-adc6-fbce39d25a19 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:00.752483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:00.833368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7931aa8-f9c5-459f-adc6-fbce39d25a19 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:00.867838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05766e3c-3d44-4f5a-8d2a-34099d7bd937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:00.868459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05766e3c-3d44-4f5a-8d2a-34099d7bd937 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:00.868742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05766e3c-3d44-4f5a-8d2a-34099d7bd937 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:00.869017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05766e3c-3d44-4f5a-8d2a-34099d7bd937 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:00.879050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05766e3c-3d44-4f5a-8d2a-34099d7bd937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-05766e3c-3d44-4f5a-8d2a-34099d7bd937 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:47:00.884011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:00.885150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:00.886007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 640/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:47:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:00.891307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b6320-a2d5-449c-9837-9005d0416ec0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:00.987731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b6320-a2d5-449c-9837-9005d0416ec0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:01.015439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:01.020385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4a47c-eb0a-45c2-8acd-d66f4e73bb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:01.020996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a47c-eb0a-45c2-8acd-d66f4e73bb95 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:01.021272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a47c-eb0a-45c2-8acd-d66f4e73bb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:01.021542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4a47c-eb0a-45c2-8acd-d66f4e73bb95 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:01.022264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4a47c-eb0a-45c2-8acd-d66f4e73bb95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:01.022608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4a47c-eb0a-45c2-8acd-d66f4e73bb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:01.024082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4a47c-eb0a-45c2-8acd-d66f4e73bb95 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:01.031801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 610/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:47:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:01.038228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05766e3c-3d44-4f5a-8d2a-34099d7bd937 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:01.115098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:01.136942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05766e3c-3d44-4f5a-8d2a-34099d7bd937 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:01.170507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fe497-97d6-42ad-b5bd-19ca6ca994b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:01.171191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fe497-97d6-42ad-b5bd-19ca6ca994b6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:01.171477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fe497-97d6-42ad-b5bd-19ca6ca994b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:01.171755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fe497-97d6-42ad-b5bd-19ca6ca994b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:01.181342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fe497-97d6-42ad-b5bd-19ca6ca994b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:01.182833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fe497-97d6-42ad-b5bd-19ca6ca994b6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b57fe497-97d6-42ad-b5bd-19ca6ca994b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:47:01.196791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:01.197886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:47:01.198930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:47:01.198930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:01.198930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:01.198930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 641/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:01.203986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4a47c-eb0a-45c2-8acd-d66f4e73bb95 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:01.301329 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4a47c-eb0a-45c2-8acd-d66f4e73bb95 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:01.334476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d54c4d-cf8a-4042-ad91-3fb6c6e1da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:01.335104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d54c4d-cf8a-4042-ad91-3fb6c6e1da0f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:01.335380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d54c4d-cf8a-4042-ad91-3fb6c6e1da0f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:01.335650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d54c4d-cf8a-4042-ad91-3fb6c6e1da0f None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:01.336284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d54c4d-cf8a-4042-ad91-3fb6c6e1da0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:01.336585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d54c4d-cf8a-4042-ad91-3fb6c6e1da0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:01.337942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d54c4d-cf8a-4042-ad91-3fb6c6e1da0f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:01.350268 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 611/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:01.356114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fe497-97d6-42ad-b5bd-19ca6ca994b6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:01.455663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fe497-97d6-42ad-b5bd-19ca6ca994b6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:01.481649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:01.489218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784cf16-4161-4899-acad-f7469d8b783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:01.489842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cf16-4161-4899-acad-f7469d8b783e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:01.490156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cf16-4161-4899-acad-f7469d8b783e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:01.490430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cf16-4161-4899-acad-f7469d8b783e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:01.497053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784cf16-4161-4899-acad-f7469d8b783e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:01.498525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784cf16-4161-4899-acad-f7469d8b783e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9784cf16-4161-4899-acad-f7469d8b783e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:47:01.510190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:01.511502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:01.512780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 642/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:47:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:01.517201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d54c4d-cf8a-4042-ad91-3fb6c6e1da0f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:01.570296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:01.614710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d54c4d-cf8a-4042-ad91-3fb6c6e1da0f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:01.647984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0acc-5970-449a-b697-b03bfe3191d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:01.648578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0acc-5970-449a-b697-b03bfe3191d9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:01.648861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0acc-5970-449a-b697-b03bfe3191d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:01.649130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0acc-5970-449a-b697-b03bfe3191d9 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:01.649851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e0acc-5970-449a-b697-b03bfe3191d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:01.650180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e0acc-5970-449a-b697-b03bfe3191d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:01.651642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e0acc-5970-449a-b697-b03bfe3191d9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:01.669282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 612/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 08:47:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:01.675187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784cf16-4161-4899-acad-f7469d8b783e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:01.774075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784cf16-4161-4899-acad-f7469d8b783e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:01.806407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3e353-f44d-430b-b861-3c245c82d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:01.807016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3e353-f44d-430b-b861-3c245c82d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:01.807300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3e353-f44d-430b-b861-3c245c82d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:01.807575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3e353-f44d-430b-b861-3c245c82d7d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:01.861567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:01.873497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3e353-f44d-430b-b861-3c245c82d7d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:01.874989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3e353-f44d-430b-b861-3c245c82d7d1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:01.971968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 643/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:47:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:47:01.977802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0acc-5970-449a-b697-b03bfe3191d9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:02.074534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e0acc-5970-449a-b697-b03bfe3191d9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:02.086904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:02.108737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385ad1c-712c-44ef-ae75-d42283d03ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:02.109359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385ad1c-712c-44ef-ae75-d42283d03ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:02.109639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385ad1c-712c-44ef-ae75-d42283d03ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:02.109909 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385ad1c-712c-44ef-ae75-d42283d03ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:02.119981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385ad1c-712c-44ef-ae75-d42283d03ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:02.121347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385ad1c-712c-44ef-ae75-d42283d03ca0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6385ad1c-712c-44ef-ae75-d42283d03ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:47:02.136597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:02.137699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:47:02.139041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:47:02.139041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:02.139041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:02.139041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 613/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:02.143475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3e353-f44d-430b-b861-3c245c82d7d1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:02.227658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:02.239595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3e353-f44d-430b-b861-3c245c82d7d1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:02.272796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b6cc2-3910-4534-bd74-aac3d7b7765b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:02.273394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b6cc2-3910-4534-bd74-aac3d7b7765b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:02.273676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b6cc2-3910-4534-bd74-aac3d7b7765b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:02.273948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b6cc2-3910-4534-bd74-aac3d7b7765b None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:02.274661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b6cc2-3910-4534-bd74-aac3d7b7765b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:02.275039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b6cc2-3910-4534-bd74-aac3d7b7765b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:02.276401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b6cc2-3910-4534-bd74-aac3d7b7765b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:02.288626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 644/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:02.294590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385ad1c-712c-44ef-ae75-d42283d03ca0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:02.391263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385ad1c-712c-44ef-ae75-d42283d03ca0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:02.424529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0ebe-b032-41d9-b120-049b449c031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:02.425149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0ebe-b032-41d9-b120-049b449c031e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:02.425429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0ebe-b032-41d9-b120-049b449c031e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:02.425701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0ebe-b032-41d9-b120-049b449c031e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:02.432066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0ebe-b032-41d9-b120-049b449c031e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:02.433525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0ebe-b032-41d9-b120-049b449c031e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7d2d0ebe-b032-41d9-b120-049b449c031e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:47:02.444433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:02.445323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:02.446429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:47:02.446429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:47:02.446429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:47:02.446429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:47:02.446429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:47:02.446429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:47:02.446429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:47:02.446429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:02.446429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 614/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:02.451467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b6cc2-3910-4534-bd74-aac3d7b7765b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:02.548461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b6cc2-3910-4534-bd74-aac3d7b7765b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:02.580785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489c54a-0497-4546-aaf3-dd64b10a7229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:02.581384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489c54a-0497-4546-aaf3-dd64b10a7229 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:02.581664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489c54a-0497-4546-aaf3-dd64b10a7229 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:02.581937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489c54a-0497-4546-aaf3-dd64b10a7229 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:02.582654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489c54a-0497-4546-aaf3-dd64b10a7229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:02.583073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489c54a-0497-4546-aaf3-dd64b10a7229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:02.584453 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489c54a-0497-4546-aaf3-dd64b10a7229 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:02.597514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 645/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:47:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:02.603541 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0ebe-b032-41d9-b120-049b449c031e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:02.629180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:02.700764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0ebe-b032-41d9-b120-049b449c031e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:02.735171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a8685-0aec-4c51-ac35-c05cd8d0cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:02.735767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a8685-0aec-4c51-ac35-c05cd8d0cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:02.736091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a8685-0aec-4c51-ac35-c05cd8d0cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:02.736369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a8685-0aec-4c51-ac35-c05cd8d0cfa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:02.737086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a8685-0aec-4c51-ac35-c05cd8d0cfa7 None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=efba357340ac47dca0b1742d4e04fd7c) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:02.737408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a8685-0aec-4c51-ac35-c05cd8d0cfa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:02.738903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a8685-0aec-4c51-ac35-c05cd8d0cfa7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:02.744128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 615/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:47:02 2022] GET /identity/v3/role_assignments?user.id=efba357340ac47dca0b1742d4e04fd7c&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:04.836646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9e341-e69e-4f99-b98d-8a328e55421e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:04.837172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9e341-e69e-4f99-b98d-8a328e55421e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:04.837172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9e341-e69e-4f99-b98d-8a328e55421e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:04.838727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 646/1261] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:04.844002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735ed8f-6e16-4506-8651-851cd071e77b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:04.847416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735ed8f-6e16-4506-8651-851cd071e77b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:04.847416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735ed8f-6e16-4506-8651-851cd071e77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:04.863438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8735ed8f-6e16-4506-8651-851cd071e77b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:04.864596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8735ed8f-6e16-4506-8651-851cd071e77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:04.930809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 616/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:47:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:47:05.201571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9e341-e69e-4f99-b98d-8a328e55421e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:05.212335 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:05.299554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9e341-e69e-4f99-b98d-8a328e55421e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:05.331733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890e884-c2c5-404b-8740-397eaf02a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:05.332365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e884-c2c5-404b-8740-397eaf02a3bc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:05.332672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e884-c2c5-404b-8740-397eaf02a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:05.332947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e884-c2c5-404b-8740-397eaf02a3bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:05.342631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890e884-c2c5-404b-8740-397eaf02a3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1890e884-c2c5-404b-8740-397eaf02a3bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:47:05.348364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:05.350601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:05.351435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 647/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:47:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:05.355551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735ed8f-6e16-4506-8651-851cd071e77b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:05.374005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:05.451438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735ed8f-6e16-4506-8651-851cd071e77b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:05.484680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b042d1-2451-478d-b180-e6eacfcbdc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:05.485260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b042d1-2451-478d-b180-e6eacfcbdc5a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:05.485549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b042d1-2451-478d-b180-e6eacfcbdc5a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:05.485910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b042d1-2451-478d-b180-e6eacfcbdc5a None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:05.487090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b042d1-2451-478d-b180-e6eacfcbdc5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:05.487398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b042d1-2451-478d-b180-e6eacfcbdc5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:05.488763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b042d1-2451-478d-b180-e6eacfcbdc5a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:05.496553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 617/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:47:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:05.502552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890e884-c2c5-404b-8740-397eaf02a3bc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:05.567119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:05.599787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890e884-c2c5-404b-8740-397eaf02a3bc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:05.632392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e852-480b-404f-93e8-ae62fc01bdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:05.633014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e852-480b-404f-93e8-ae62fc01bdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:05.633294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e852-480b-404f-93e8-ae62fc01bdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:05.633565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e852-480b-404f-93e8-ae62fc01bdb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:05.644100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611e852-480b-404f-93e8-ae62fc01bdb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:05.645536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611e852-480b-404f-93e8-ae62fc01bdb4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1611e852-480b-404f-93e8-ae62fc01bdb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:47:05.660419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:05.661547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:47:05.662523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:47:05.662523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:05.662523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:05.662523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 648/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:05.667589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b042d1-2451-478d-b180-e6eacfcbdc5a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:05.747962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:05.766010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b042d1-2451-478d-b180-e6eacfcbdc5a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:05.799490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7439f8-3ee8-42be-8f4c-48a6b214a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:05.800094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7439f8-3ee8-42be-8f4c-48a6b214a732 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:05.800380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7439f8-3ee8-42be-8f4c-48a6b214a732 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:05.800728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7439f8-3ee8-42be-8f4c-48a6b214a732 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:05.801359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7439f8-3ee8-42be-8f4c-48a6b214a732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:05.801665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7439f8-3ee8-42be-8f4c-48a6b214a732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:05.803066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7439f8-3ee8-42be-8f4c-48a6b214a732 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:05.814940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 618/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:05.820787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e852-480b-404f-93e8-ae62fc01bdb4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:05.918513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e852-480b-404f-93e8-ae62fc01bdb4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:05.937937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:05.952405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d93f-64c3-4fdc-a45e-7fb7f044208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:05.953206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d93f-64c3-4fdc-a45e-7fb7f044208a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:05.954366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d93f-64c3-4fdc-a45e-7fb7f044208a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:05.954366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1d93f-64c3-4fdc-a45e-7fb7f044208a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:05.961771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1d93f-64c3-4fdc-a45e-7fb7f044208a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:05.963256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1d93f-64c3-4fdc-a45e-7fb7f044208a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-45b1d93f-64c3-4fdc-a45e-7fb7f044208a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:47:05.975330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:05.976543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:05.977909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 649/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:47:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:05.983371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7439f8-3ee8-42be-8f4c-48a6b214a732 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:06.078725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7439f8-3ee8-42be-8f4c-48a6b214a732 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:06.112212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc393e-5460-446a-8120-d95ea2344754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:06.112810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc393e-5460-446a-8120-d95ea2344754 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:06.113092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc393e-5460-446a-8120-d95ea2344754 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:06.113381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc393e-5460-446a-8120-d95ea2344754 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:06.114105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc393e-5460-446a-8120-d95ea2344754 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:06.114428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc393e-5460-446a-8120-d95ea2344754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:06.115925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc393e-5460-446a-8120-d95ea2344754 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:06.124423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:06.133259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 619/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 08:47:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:06.139369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d93f-64c3-4fdc-a45e-7fb7f044208a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:06.238213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1d93f-64c3-4fdc-a45e-7fb7f044208a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:06.271651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6e6f0-af1d-4548-99cf-812eefb648d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:06.272325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e6f0-af1d-4548-99cf-812eefb648d1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:06.272609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e6f0-af1d-4548-99cf-812eefb648d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:06.272879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e6f0-af1d-4548-99cf-812eefb648d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:06.283970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6e6f0-af1d-4548-99cf-812eefb648d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:06.285416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6e6f0-af1d-4548-99cf-812eefb648d1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-05f6e6f0-af1d-4548-99cf-812eefb648d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:47:06.298978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:06.300087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:47:06.301049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:47:06.301049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:06.301049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:06.301049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 650/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:06.306058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc393e-5460-446a-8120-d95ea2344754 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:06.403271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc393e-5460-446a-8120-d95ea2344754 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:06.435839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e3b70-41c6-44a9-8f81-c9bde23553fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:06.436443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e3b70-41c6-44a9-8f81-c9bde23553fd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:06.436724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e3b70-41c6-44a9-8f81-c9bde23553fd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:06.436996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e3b70-41c6-44a9-8f81-c9bde23553fd None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:06.437636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e3b70-41c6-44a9-8f81-c9bde23553fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:06.437940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e3b70-41c6-44a9-8f81-c9bde23553fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:06.440052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e3b70-41c6-44a9-8f81-c9bde23553fd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:06.450924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 620/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:06.457143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6e6f0-af1d-4548-99cf-812eefb648d1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:06.490443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:06.555905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6e6f0-af1d-4548-99cf-812eefb648d1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:06.588968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31d77a-c863-46d3-90e5-d4a2f4fd4589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:06.589587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31d77a-c863-46d3-90e5-d4a2f4fd4589 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:06.589871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31d77a-c863-46d3-90e5-d4a2f4fd4589 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:06.590173 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31d77a-c863-46d3-90e5-d4a2f4fd4589 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:06.596845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31d77a-c863-46d3-90e5-d4a2f4fd4589 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:06.598344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31d77a-c863-46d3-90e5-d4a2f4fd4589 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2b31d77a-c863-46d3-90e5-d4a2f4fd4589 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:47:06.609303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:06.610393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:06.612147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:47:06.612147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:47:06.612147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:47:06.612147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:47:06.612147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:47:06.612147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:47:06.612147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:47:06.612147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:06.612147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 651/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:47:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:06.616965 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e3b70-41c6-44a9-8f81-c9bde23553fd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:06.673891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:06.713481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e3b70-41c6-44a9-8f81-c9bde23553fd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:06.745327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51c505-971d-425a-986c-925751026569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:06.745925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c505-971d-425a-986c-925751026569 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:06.746236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c505-971d-425a-986c-925751026569 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:06.746513 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c505-971d-425a-986c-925751026569 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:06.747200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51c505-971d-425a-986c-925751026569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:06.747507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51c505-971d-425a-986c-925751026569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:06.748926 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51c505-971d-425a-986c-925751026569 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:06.760840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 621/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:47:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:06.767161 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31d77a-c863-46d3-90e5-d4a2f4fd4589 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:06.856727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:06.865589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31d77a-c863-46d3-90e5-d4a2f4fd4589 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:06.897604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c6090-254f-444b-804d-470f14e2892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:06.898282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6090-254f-444b-804d-470f14e2892e None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:06.898562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6090-254f-444b-804d-470f14e2892e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:06.898833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6090-254f-444b-804d-470f14e2892e None admin] PATH_INFO: `/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/efba357340ac47dca0b1742d4e04fd7c/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:06.900684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c6090-254f-444b-804d-470f14e2892e None admin] RBAC: Authorizing `identity:create_grant(project_id=0a26eb92cd34484d85c22122d36b56c0, user_id=efba357340ac47dca0b1742d4e04fd7c, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:06.902164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c6090-254f-444b-804d-470f14e2892e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:06.973974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 652/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Oct 4 08:47:06 2022] PUT /identity/v3/projects/0a26eb92cd34484d85c22122d36b56c0/users/efba357340ac47dca0b1742d4e04fd7c/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:47:09.103271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc950-8f47-4196-a28e-9b71c21c4524 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:09.103793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc950-8f47-4196-a28e-9b71c21c4524 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:09.103884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc950-8f47-4196-a28e-9b71c21c4524 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:09.105195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 622/1274] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:09.110526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f075e-2b92-4bd1-8b52-c3e469a560fe None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:09.110921 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f075e-2b92-4bd1-8b52-c3e469a560fe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:09.111076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f075e-2b92-4bd1-8b52-c3e469a560fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:09.129415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ca8f075e-2b92-4bd1-8b52-c3e469a560fe None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:09.130637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ca8f075e-2b92-4bd1-8b52-c3e469a560fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:09.195621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 653/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:47:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:47:09.467344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc950-8f47-4196-a28e-9b71c21c4524 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:09.566779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc950-8f47-4196-a28e-9b71c21c4524 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:09.583398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:09.599598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641776-6264-4d43-9ee1-03923db711f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:09.600275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641776-6264-4d43-9ee1-03923db711f5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:09.600554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641776-6264-4d43-9ee1-03923db711f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:09.600829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641776-6264-4d43-9ee1-03923db711f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:09.610450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41641776-6264-4d43-9ee1-03923db711f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-41641776-6264-4d43-9ee1-03923db711f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:47:09.615799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:09.616916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:09.618107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 623/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Oct 4 08:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:09.623225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f075e-2b92-4bd1-8b52-c3e469a560fe None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:09.701908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:09.719553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f075e-2b92-4bd1-8b52-c3e469a560fe None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:09.753569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c587e-9c2d-4ae1-81ed-0322c28c39dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:09.754207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c587e-9c2d-4ae1-81ed-0322c28c39dd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:09.754520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c587e-9c2d-4ae1-81ed-0322c28c39dd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:09.754794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c587e-9c2d-4ae1-81ed-0322c28c39dd None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:09.755457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c587e-9c2d-4ae1-81ed-0322c28c39dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:09.755764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c587e-9c2d-4ae1-81ed-0322c28c39dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:09.757145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c587e-9c2d-4ae1-81ed-0322c28c39dd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:09.764858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 654/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Oct 4 08:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:09.770675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641776-6264-4d43-9ee1-03923db711f5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:09.868111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641776-6264-4d43-9ee1-03923db711f5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:09.900185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f1216-f38a-4971-8e5e-f2c2ed325676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:09.900810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1216-f38a-4971-8e5e-f2c2ed325676 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:09.901086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1216-f38a-4971-8e5e-f2c2ed325676 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:09.901354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1216-f38a-4971-8e5e-f2c2ed325676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:09.911602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f1216-f38a-4971-8e5e-f2c2ed325676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:09.913094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f1216-f38a-4971-8e5e-f2c2ed325676 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4d6f1216-f38a-4971-8e5e-f2c2ed325676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:47:09.927702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:09.930361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:47:09.931263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:47:09.931263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:09.931263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:09.931263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 624/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:09.935082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c587e-9c2d-4ae1-81ed-0322c28c39dd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.033083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c587e-9c2d-4ae1-81ed-0322c28c39dd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.065938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c15564-0fef-49cf-852b-b2973ed7dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.066561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c15564-0fef-49cf-852b-b2973ed7dd57 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.066845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c15564-0fef-49cf-852b-b2973ed7dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.067119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c15564-0fef-49cf-852b-b2973ed7dd57 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.067758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c15564-0fef-49cf-852b-b2973ed7dd57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.068061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c15564-0fef-49cf-852b-b2973ed7dd57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.069436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c15564-0fef-49cf-852b-b2973ed7dd57 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.080772 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 655/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.086485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f1216-f38a-4971-8e5e-f2c2ed325676 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.117081 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:10.181625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f1216-f38a-4971-8e5e-f2c2ed325676 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.215158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760125c-7a53-4290-b7d4-c6890ebb92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.215841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760125c-7a53-4290-b7d4-c6890ebb92bc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.216126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760125c-7a53-4290-b7d4-c6890ebb92bc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.216402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760125c-7a53-4290-b7d4-c6890ebb92bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.224116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760125c-7a53-4290-b7d4-c6890ebb92bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.225543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760125c-7a53-4290-b7d4-c6890ebb92bc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7760125c-7a53-4290-b7d4-c6890ebb92bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:47:10.236789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:10.237929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:10.238906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 625/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:10.243704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c15564-0fef-49cf-852b-b2973ed7dd57 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.247497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:10.340813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c15564-0fef-49cf-852b-b2973ed7dd57 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.373477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3527-457b-4bad-b658-04534ad6056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.374106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3527-457b-4bad-b658-04534ad6056e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.374382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3527-457b-4bad-b658-04534ad6056e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.374657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3527-457b-4bad-b658-04534ad6056e None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.375383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3527-457b-4bad-b658-04534ad6056e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.375691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3527-457b-4bad-b658-04534ad6056e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.377145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3527-457b-4bad-b658-04534ad6056e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.394252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 656/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:10.400096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760125c-7a53-4290-b7d4-c6890ebb92bc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.487311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:10.496243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760125c-7a53-4290-b7d4-c6890ebb92bc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.529329 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b9e2-940f-4f43-aed4-983d03bbaf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.529920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b9e2-940f-4f43-aed4-983d03bbaf45 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.530261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b9e2-940f-4f43-aed4-983d03bbaf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.530532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b9e2-940f-4f43-aed4-983d03bbaf45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.593959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38b9e2-940f-4f43-aed4-983d03bbaf45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.595692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38b9e2-940f-4f43-aed4-983d03bbaf45 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.679473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:10.689723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 626/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:47:10.695714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3527-457b-4bad-b658-04534ad6056e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.756331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:10.792939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3527-457b-4bad-b658-04534ad6056e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.825841 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df31d7-c8ee-4222-9350-c09a81fda925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.826485 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df31d7-c8ee-4222-9350-c09a81fda925 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.826772 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df31d7-c8ee-4222-9350-c09a81fda925 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.827044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df31d7-c8ee-4222-9350-c09a81fda925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.837492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df31d7-c8ee-4222-9350-c09a81fda925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.838960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df31d7-c8ee-4222-9350-c09a81fda925 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-36df31d7-c8ee-4222-9350-c09a81fda925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:47:10.853022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:10.854185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:47:10.855299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:47:10.855299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:47:10.855299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:10.855299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 657/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:10.861960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b9e2-940f-4f43-aed4-983d03bbaf45 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:10.957401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b9e2-940f-4f43-aed4-983d03bbaf45 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:10.990062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa183a93-ba6a-40dd-bc82-cb31d83eb36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:10.990688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa183a93-ba6a-40dd-bc82-cb31d83eb36a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:10.990968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa183a93-ba6a-40dd-bc82-cb31d83eb36a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:10.991239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa183a93-ba6a-40dd-bc82-cb31d83eb36a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:10.991876 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa183a93-ba6a-40dd-bc82-cb31d83eb36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:10.992180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa183a93-ba6a-40dd-bc82-cb31d83eb36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:10.993527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa183a93-ba6a-40dd-bc82-cb31d83eb36a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.004861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 627/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Oct 4 08:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:11.010552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df31d7-c8ee-4222-9350-c09a81fda925 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.109384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df31d7-c8ee-4222-9350-c09a81fda925 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.122828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:11.141948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f02f17-13ea-4da1-a330-cd81b5c71cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.142590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02f17-13ea-4da1-a330-cd81b5c71cfe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.142866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02f17-13ea-4da1-a330-cd81b5c71cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.143129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f02f17-13ea-4da1-a330-cd81b5c71cfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.149496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f02f17-13ea-4da1-a330-cd81b5c71cfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.150974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f02f17-13ea-4da1-a330-cd81b5c71cfe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-45f02f17-13ea-4da1-a330-cd81b5c71cfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:47:11.161764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:11.162808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:11.163814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:47:11.163814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:47:11.163814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:47:11.163814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:47:11.163814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:47:11.163814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:47:11.163814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:47:11.163814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Oct 04 08:47:11.163814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 658/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:11.168723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa183a93-ba6a-40dd-bc82-cb31d83eb36a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.216953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:11.264898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa183a93-ba6a-40dd-bc82-cb31d83eb36a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.297073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68bc9f-9bd0-4e52-84a1-2d496ccfb4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.297666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68bc9f-9bd0-4e52-84a1-2d496ccfb4fa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.298047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68bc9f-9bd0-4e52-84a1-2d496ccfb4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.298839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68bc9f-9bd0-4e52-84a1-2d496ccfb4fa None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.299521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68bc9f-9bd0-4e52-84a1-2d496ccfb4fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:11.299827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68bc9f-9bd0-4e52-84a1-2d496ccfb4fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.301246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68bc9f-9bd0-4e52-84a1-2d496ccfb4fa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.315938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 628/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:11.322004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f02f17-13ea-4da1-a330-cd81b5c71cfe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:11.418908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f02f17-13ea-4da1-a330-cd81b5c71cfe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:11.451048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72869769-0610-4d3f-a78e-3d5e750e3f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:11.451630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72869769-0610-4d3f-a78e-3d5e750e3f1a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:11.451906 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72869769-0610-4d3f-a78e-3d5e750e3f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:11.452185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72869769-0610-4d3f-a78e-3d5e750e3f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:11.452886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72869769-0610-4d3f-a78e-3d5e750e3f1a None admin] RBAC: Adding query filter params (role.id=935a135c8de34a7f9088b7a920d3caf2, scope.project.id=0a26eb92cd34484d85c22122d36b56c0, user.id=efba357340ac47dca0b1742d4e04fd7c) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:11.453188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72869769-0610-4d3f-a78e-3d5e750e3f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:11.454669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72869769-0610-4d3f-a78e-3d5e750e3f1a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:11.460346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 659/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Oct 4 08:47:11 2022] GET /identity/v3/role_assignments?user.id=efba357340ac47dca0b1742d4e04fd7c&scope.project.id=0a26eb92cd34484d85c22122d36b56c0&role.id=935a135c8de34a7f9088b7a920d3caf2 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:13.590591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6ba1-d062-49fd-9d4c-11c0decdb8e3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.591187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6ba1-d062-49fd-9d4c-11c0decdb8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.591187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6ba1-d062-49fd-9d4c-11c0decdb8e3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.592500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 629/1288] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:13.598480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20656aa-989a-4b8b-8fd3-28bf68ddddb6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:13.598853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20656aa-989a-4b8b-8fd3-28bf68ddddb6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:13.599026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20656aa-989a-4b8b-8fd3-28bf68ddddb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:13.617540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f20656aa-989a-4b8b-8fd3-28bf68ddddb6 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:13.618756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f20656aa-989a-4b8b-8fd3-28bf68ddddb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:13.646663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:13.682421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 660/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:47:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:47:13.951952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6ba1-d062-49fd-9d4c-11c0decdb8e3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:14.052695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6ba1-d062-49fd-9d4c-11c0decdb8e3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:14.062934 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:14.085948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a7e50-9755-46e8-af6a-771a10c3a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:14.086595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a7e50-9755-46e8-af6a-771a10c3a302 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:14.086876 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a7e50-9755-46e8-af6a-771a10c3a302 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:14.087144 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a7e50-9755-46e8-af6a-771a10c3a302 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:14.087719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a7e50-9755-46e8-af6a-771a10c3a302 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:14.089074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a7e50-9755-46e8-af6a-771a10c3a302 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-483a7e50-9755-46e8-af6a-771a10c3a302 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:14.098860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:14.110420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:14.111550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 630/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:47:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:14.112605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20656aa-989a-4b8b-8fd3-28bf68ddddb6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:14.201264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20656aa-989a-4b8b-8fd3-28bf68ddddb6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:14.235155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a08f15-15d0-4b30-8877-0e4ad5197a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:14.235789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a08f15-15d0-4b30-8877-0e4ad5197a39 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:14.236070 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a08f15-15d0-4b30-8877-0e4ad5197a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:14.236341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a08f15-15d0-4b30-8877-0e4ad5197a39 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:14.236970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a08f15-15d0-4b30-8877-0e4ad5197a39 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:14.237274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a08f15-15d0-4b30-8877-0e4ad5197a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:14.238676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a08f15-15d0-4b30-8877-0e4ad5197a39 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:14.243378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 661/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Oct 4 08:47:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:14.249154 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a7e50-9755-46e8-af6a-771a10c3a302 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:14.345409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a7e50-9755-46e8-af6a-771a10c3a302 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:14.377376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0e6ca-ae22-400d-9ae1-84e3d41b03b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:14.377968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0e6ca-ae22-400d-9ae1-84e3d41b03b9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:14.378284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0e6ca-ae22-400d-9ae1-84e3d41b03b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:14.378557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0e6ca-ae22-400d-9ae1-84e3d41b03b9 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:14.379183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0e6ca-ae22-400d-9ae1-84e3d41b03b9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:14.379492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0e6ca-ae22-400d-9ae1-84e3d41b03b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:14.380847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0e6ca-ae22-400d-9ae1-84e3d41b03b9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:14.385148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 631/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Oct 4 08:47:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:16.513406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a281-2dac-4022-8bb7-b89da8f4f295 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:16.513958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a281-2dac-4022-8bb7-b89da8f4f295 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:16.514062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64a281-2dac-4022-8bb7-b89da8f4f295 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:16.515365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 662/1293] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:16.521201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251923a-dd4c-41d5-96b1-110fd9eddf13 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:16.521635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251923a-dd4c-41d5-96b1-110fd9eddf13 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:16.521757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251923a-dd4c-41d5-96b1-110fd9eddf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:16.539483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3251923a-dd4c-41d5-96b1-110fd9eddf13 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:16.540660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3251923a-dd4c-41d5-96b1-110fd9eddf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:16.569383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:16.605661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 632/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:47:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:47:16.873654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64a281-2dac-4022-8bb7-b89da8f4f295 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:16.904711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:16.974445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64a281-2dac-4022-8bb7-b89da8f4f295 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:17.007357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b104855-8688-4ecb-b733-7644fcf880f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:17.007991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104855-8688-4ecb-b733-7644fcf880f5 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:17.008271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104855-8688-4ecb-b733-7644fcf880f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:17.008540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b104855-8688-4ecb-b733-7644fcf880f5 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:17.009192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b104855-8688-4ecb-b733-7644fcf880f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:17.010775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b104855-8688-4ecb-b733-7644fcf880f5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:17.118148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 663/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Oct 4 08:47:16 2022] POST /identity/v3/services => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:19.228219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51899f8-85a2-4e01-8b52-a0ef2c18817f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:19.228789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51899f8-85a2-4e01-8b52-a0ef2c18817f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:19.228789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51899f8-85a2-4e01-8b52-a0ef2c18817f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:19.230096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 633/1296] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:19.235326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec263b7c-e699-4f5a-b1e0-eaf59dc0b797 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:19.235703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec263b7c-e699-4f5a-b1e0-eaf59dc0b797 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:19.235915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec263b7c-e699-4f5a-b1e0-eaf59dc0b797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:19.253539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ec263b7c-e699-4f5a-b1e0-eaf59dc0b797 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:19.254757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec263b7c-e699-4f5a-b1e0-eaf59dc0b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:19.325608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 664/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:47:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:47:19.595799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51899f8-85a2-4e01-8b52-a0ef2c18817f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:19.695083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51899f8-85a2-4e01-8b52-a0ef2c18817f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:19.728931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124a2ee-8b8e-4a7c-86e9-445007d30b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:19.729554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124a2ee-8b8e-4a7c-86e9-445007d30b67 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:19.729836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124a2ee-8b8e-4a7c-86e9-445007d30b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:19.730135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124a2ee-8b8e-4a7c-86e9-445007d30b67 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:19.730719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124a2ee-8b8e-4a7c-86e9-445007d30b67 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:19.732080 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124a2ee-8b8e-4a7c-86e9-445007d30b67 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1124a2ee-8b8e-4a7c-86e9-445007d30b67 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:19.740806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:19.741985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:19.742901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 634/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:47:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:19.747985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec263b7c-e699-4f5a-b1e0-eaf59dc0b797 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:19.767522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:19.848236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec263b7c-e699-4f5a-b1e0-eaf59dc0b797 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:19.883068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c410e04-57e2-4b5b-88a6-5c1a7f96ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:19.883677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410e04-57e2-4b5b-88a6-5c1a7f96ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:19.883958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410e04-57e2-4b5b-88a6-5c1a7f96ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:19.884233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c410e04-57e2-4b5b-88a6-5c1a7f96ffd4 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:19.884878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c410e04-57e2-4b5b-88a6-5c1a7f96ffd4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:19.885184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c410e04-57e2-4b5b-88a6-5c1a7f96ffd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:19.886595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c410e04-57e2-4b5b-88a6-5c1a7f96ffd4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:19.892284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 665/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Oct 4 08:47:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:19.898383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124a2ee-8b8e-4a7c-86e9-445007d30b67 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:19.929814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:19.998057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124a2ee-8b8e-4a7c-86e9-445007d30b67 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:20.031445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8815160-dcf0-45ba-80cc-992e2ce63032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:20.032602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8815160-dcf0-45ba-80cc-992e2ce63032 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:20.032885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8815160-dcf0-45ba-80cc-992e2ce63032 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:20.033162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8815160-dcf0-45ba-80cc-992e2ce63032 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:20.033869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8815160-dcf0-45ba-80cc-992e2ce63032 None admin] RBAC: Adding query filter params (interface=public, service_id=cbe90631919b45bc99285d22a016e1e8, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:20.034216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8815160-dcf0-45ba-80cc-992e2ce63032 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:20.035698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8815160-dcf0-45ba-80cc-992e2ce63032 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:20.040644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 635/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Oct 4 08:47:19 2022] GET /identity/v3/endpoints?service_id=cbe90631919b45bc99285d22a016e1e8&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:20.046472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c410e04-57e2-4b5b-88a6-5c1a7f96ffd4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:20.129261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:20.146838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c410e04-57e2-4b5b-88a6-5c1a7f96ffd4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:20.179183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a380c-ff79-49b8-aea3-332f3bbc8abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:20.179771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a380c-ff79-49b8-aea3-332f3bbc8abd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:20.180047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a380c-ff79-49b8-aea3-332f3bbc8abd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:20.180315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a380c-ff79-49b8-aea3-332f3bbc8abd None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:20.180911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a380c-ff79-49b8-aea3-332f3bbc8abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:20.186503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a380c-ff79-49b8-aea3-332f3bbc8abd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:20.193166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 666/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Oct 4 08:47:20 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:22.336011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c244ad-2654-48d4-b1f6-756ea8d7e067 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:22.336563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c244ad-2654-48d4-b1f6-756ea8d7e067 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:22.336563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c244ad-2654-48d4-b1f6-756ea8d7e067 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:22.337803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 636/1302] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:47:22.343007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966bfd-07bf-4841-9040-12321251b532 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:22.343379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966bfd-07bf-4841-9040-12321251b532 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:22.343808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966bfd-07bf-4841-9040-12321251b532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:22.362031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-92966bfd-07bf-4841-9040-12321251b532 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:22.363233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-92966bfd-07bf-4841-9040-12321251b532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:22.427674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 667/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:47:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:47:22.699620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c244ad-2654-48d4-b1f6-756ea8d7e067 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:22.794268 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:22.801566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c244ad-2654-48d4-b1f6-756ea8d7e067 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:22.835891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758f744-ffd0-458f-ba74-261db6f99ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:22.836513 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758f744-ffd0-458f-ba74-261db6f99ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:22.836796 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758f744-ffd0-458f-ba74-261db6f99ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:22.837066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758f744-ffd0-458f-ba74-261db6f99ad2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:22.837644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758f744-ffd0-458f-ba74-261db6f99ad2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:22.839039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758f744-ffd0-458f-ba74-261db6f99ad2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e758f744-ffd0-458f-ba74-261db6f99ad2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:47:22.848298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:47:22.853799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Oct 04 08:47:22.854997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 637/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Oct 4 08:47:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:47:22.855983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966bfd-07bf-4841-9040-12321251b532 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:22.928525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:22.951885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966bfd-07bf-4841-9040-12321251b532 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:22.986347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5aa993-3493-44f8-b525-9d3b37272869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:22.986942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa993-3493-44f8-b525-9d3b37272869 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:22.987219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa993-3493-44f8-b525-9d3b37272869 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:22.987487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa993-3493-44f8-b525-9d3b37272869 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:22.988110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5aa993-3493-44f8-b525-9d3b37272869 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:22.988413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5aa993-3493-44f8-b525-9d3b37272869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:22.989769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5aa993-3493-44f8-b525-9d3b37272869 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:22.994712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 668/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Oct 4 08:47:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:23.000486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758f744-ffd0-458f-ba74-261db6f99ad2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:23.099230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758f744-ffd0-458f-ba74-261db6f99ad2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:23.131823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6819b8-e64c-4e03-8c71-3be1198e2c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:23.132412 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6819b8-e64c-4e03-8c71-3be1198e2c2b None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:23.132695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6819b8-e64c-4e03-8c71-3be1198e2c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:23.133100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6819b8-e64c-4e03-8c71-3be1198e2c2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:23.134039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6819b8-e64c-4e03-8c71-3be1198e2c2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:23.135483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6819b8-e64c-4e03-8c71-3be1198e2c2b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:23.235386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 638/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:47:32.991742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=30 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:33.230703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:59.704193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f23a-4bd5-415c-8686-b361e5c2f187 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.705346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f23a-4bd5-415c-8686-b361e5c2f187 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.706167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438f23a-4bd5-415c-8686-b361e5c2f187 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.717632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8016b0-8c8d-4bde-9019-53f6a7b7d0e3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.718598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8016b0-8c8d-4bde-9019-53f6a7b7d0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.719156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8016b0-8c8d-4bde-9019-53f6a7b7d0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.725132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 669/1307] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:52:59 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:52:59.877628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1a8016b0-8c8d-4bde-9019-53f6a7b7d0e3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:59.879669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1a8016b0-8c8d-4bde-9019-53f6a7b7d0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:00.060182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 639/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:00.360448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe168b-87e6-4987-863e-d827c6a19907 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:00.361128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe168b-87e6-4987-863e-d827c6a19907 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:00.361618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe168b-87e6-4987-863e-d827c6a19907 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:00.363504 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 670/1309] 10.222.0.33 () {54 vars in 964 bytes} [Tue Oct 4 08:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:00.369439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8be47b-195c-4078-989c-815a09dc4591 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:00.370034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8be47b-195c-4078-989c-815a09dc4591 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:00.370580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8be47b-195c-4078-989c-815a09dc4591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:00.460951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8d8be47b-195c-4078-989c-815a09dc4591 None None] MFA Rules not processed for user `e0b66989d4df4398ad723f587cbc24bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:00.463111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8d8be47b-195c-4078-989c-815a09dc4591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:00.485951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:00.566542 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe168b-87e6-4987-863e-d827c6a19907 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:00.568574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dafe168b-87e6-4987-863e-d827c6a19907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:00.576849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 640/1310] 10.222.0.33 () {58 vars in 1061 bytes} [Tue Oct 4 08:53:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:00.698389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe168b-87e6-4987-863e-d827c6a19907 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:00.785971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3701d-1b67-4c4b-8cc0-06c43e995c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:00.786648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3701d-1b67-4c4b-8cc0-06c43e995c20 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:00.786967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3701d-1b67-4c4b-8cc0-06c43e995c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:00.787311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3701d-1b67-4c4b-8cc0-06c43e995c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:00.789029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-22c3701d-1b67-4c4b-8cc0-06c43e995c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:00.869273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:00.943620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3701d-1b67-4c4b-8cc0-06c43e995c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:00.945269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3701d-1b67-4c4b-8cc0-06c43e995c20 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:00.986347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 671/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:03.489877 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c2cde-1cdb-4cff-aef3-6b8e54c65625 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:03.490458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c2cde-1cdb-4cff-aef3-6b8e54c65625 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:03.490458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c2cde-1cdb-4cff-aef3-6b8e54c65625 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:03.491803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 641/1312] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:03.497085 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36943d7a-c950-4ee8-b17f-67c18d85bfb7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:03.497527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36943d7a-c950-4ee8-b17f-67c18d85bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:03.497643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36943d7a-c950-4ee8-b17f-67c18d85bfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:03.569074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-36943d7a-c950-4ee8-b17f-67c18d85bfb7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:03.570305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-36943d7a-c950-4ee8-b17f-67c18d85bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:03.667302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 672/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:03.947816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c2cde-1cdb-4cff-aef3-6b8e54c65625 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:03.949385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1e2c2cde-1cdb-4cff-aef3-6b8e54c65625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:04.050215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c2cde-1cdb-4cff-aef3-6b8e54c65625 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:04.120703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:04.122976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b5c42-a1d5-4f8a-a461-9e678a53dab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:04.123570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b5c42-a1d5-4f8a-a461-9e678a53dab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:04.123845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b5c42-a1d5-4f8a-a461-9e678a53dab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:04.124115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b5c42-a1d5-4f8a-a461-9e678a53dab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:04.125707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8f5b5c42-a1d5-4f8a-a461-9e678a53dab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:04.230203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b5c42-a1d5-4f8a-a461-9e678a53dab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:04.231552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b5c42-a1d5-4f8a-a461-9e678a53dab0 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:04.249498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 642/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:06.882246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6beaea-0b37-4602-9438-6c8c865d525f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.882814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6beaea-0b37-4602-9438-6c8c865d525f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.882814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6beaea-0b37-4602-9438-6c8c865d525f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.884203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 673/1315] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:06.889503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2da76-e808-4fb4-b527-c37a5027168d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.889904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2da76-e808-4fb4-b527-c37a5027168d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.890069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2da76-e808-4fb4-b527-c37a5027168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.955305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-29f2da76-e808-4fb4-b527-c37a5027168d None None] MFA Rules not processed for user `92f50ac3a70a40c081782c0cf02c739f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:06.956519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-29f2da76-e808-4fb4-b527-c37a5027168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.009085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:07.053475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 643/1316] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:07.338986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6beaea-0b37-4602-9438-6c8c865d525f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.340585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c6beaea-0b37-4602-9438-6c8c865d525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.351189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:07.441364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6beaea-0b37-4602-9438-6c8c865d525f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.515555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de76192-3ed5-4af5-ae50-8807d6d86590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.516162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de76192-3ed5-4af5-ae50-8807d6d86590 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.516445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de76192-3ed5-4af5-ae50-8807d6d86590 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.516720 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de76192-3ed5-4af5-ae50-8807d6d86590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.518385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9de76192-3ed5-4af5-ae50-8807d6d86590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.580839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:07.626183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de76192-3ed5-4af5-ae50-8807d6d86590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.627619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de76192-3ed5-4af5-ae50-8807d6d86590 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.646202 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 674/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:10.535892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c4976-e972-4bc1-b5ab-ade94080b37f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:10.536458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c4976-e972-4bc1-b5ab-ade94080b37f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:10.536458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c4976-e972-4bc1-b5ab-ade94080b37f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:10.537913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 644/1318] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:10.543451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a24bf5-8889-4552-af46-bb382516a5af None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:10.543872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a24bf5-8889-4552-af46-bb382516a5af None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:10.543995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a24bf5-8889-4552-af46-bb382516a5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:10.608538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e3a24bf5-8889-4552-af46-bb382516a5af None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:10.609759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e3a24bf5-8889-4552-af46-bb382516a5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:10.704061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 675/1319] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:10.982816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c4976-e972-4bc1-b5ab-ade94080b37f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:10.984409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-226c4976-e972-4bc1-b5ab-ade94080b37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:11.084898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c4976-e972-4bc1-b5ab-ade94080b37f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:11.157065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac89b-d21b-4f3b-9c61-d2cb7763bf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:11.157660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac89b-d21b-4f3b-9c61-d2cb7763bf9f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:11.157939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac89b-d21b-4f3b-9c61-d2cb7763bf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:11.158241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac89b-d21b-4f3b-9c61-d2cb7763bf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:11.159827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-935ac89b-d21b-4f3b-9c61-d2cb7763bf9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:11.167110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:11.265348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ac89b-d21b-4f3b-9c61-d2cb7763bf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:11.266742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ac89b-d21b-4f3b-9c61-d2cb7763bf9f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:11.284498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 645/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:14.372080 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8e710-13c5-4a5e-8edc-c26e65924cf2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.372624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8e710-13c5-4a5e-8edc-c26e65924cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.372624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8e710-13c5-4a5e-8edc-c26e65924cf2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:14.374028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 676/1321] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:14.379498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6f27-3f56-482b-8b5d-6ec7ab6478f5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.379903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6f27-3f56-482b-8b5d-6ec7ab6478f5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.380049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6f27-3f56-482b-8b5d-6ec7ab6478f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:14.445723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d96d6f27-3f56-482b-8b5d-6ec7ab6478f5 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:14.446970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d96d6f27-3f56-482b-8b5d-6ec7ab6478f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:14.504360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:14.546449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 646/1322] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:14.846909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f9bb-c0fc-4184-8a92-3329ad7835ca None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.847279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f9bb-c0fc-4184-8a92-3329ad7835ca None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.847618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f9bb-c0fc-4184-8a92-3329ad7835ca None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:14.849189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 677/1323] 10.222.0.33 () {54 vars in 964 bytes} [Tue Oct 4 08:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:14.854840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1082-26ca-4eba-8d9a-b3fd84042499 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.855133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1082-26ca-4eba-8d9a-b3fd84042499 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.855415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1082-26ca-4eba-8d9a-b3fd84042499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:14.930111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5b1b1082-26ca-4eba-8d9a-b3fd84042499 None None] MFA Rules not processed for user `e0b66989d4df4398ad723f587cbc24bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:14.931246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b1b1082-26ca-4eba-8d9a-b3fd84042499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.008199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 647/1324] 10.222.0.33 () {58 vars in 1061 bytes} [Tue Oct 4 08:53:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:15.017055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300f9bb-c0fc-4184-8a92-3329ad7835ca None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:15.018628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b300f9bb-c0fc-4184-8a92-3329ad7835ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.038063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:15.121313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300f9bb-c0fc-4184-8a92-3329ad7835ca None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:15.193384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1799aa-00aa-4741-bab9-753ddf69c557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:15.193953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1799aa-00aa-4741-bab9-753ddf69c557 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:15.194243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1799aa-00aa-4741-bab9-753ddf69c557 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:15.194514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1799aa-00aa-4741-bab9-753ddf69c557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:15.196735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8c1799aa-00aa-4741-bab9-753ddf69c557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.267372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:15.303671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1799aa-00aa-4741-bab9-753ddf69c557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:15.305649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1799aa-00aa-4741-bab9-753ddf69c557 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:15.323415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 678/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:17.731057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9c9f-49bf-4a18-a6cf-980803311059 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:17.731609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9c9f-49bf-4a18-a6cf-980803311059 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:17.731609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb9c9f-49bf-4a18-a6cf-980803311059 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.733183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 648/1326] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:17.738349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b16c-e190-435e-84cc-dcba82cbd236 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:17.738863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b16c-e190-435e-84cc-dcba82cbd236 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:17.738958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b16c-e190-435e-84cc-dcba82cbd236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.810234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e8a7b16c-e190-435e-84cc-dcba82cbd236 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:17.811438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e8a7b16c-e190-435e-84cc-dcba82cbd236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:17.909884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 679/1327] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:18.192617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb9c9f-49bf-4a18-a6cf-980803311059 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:18.194236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-acdb9c9f-49bf-4a18-a6cf-980803311059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:18.254548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:18.297006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb9c9f-49bf-4a18-a6cf-980803311059 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:18.369038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5c1f4-a3b1-4d69-9455-d2579416eab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:18.369661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5c1f4-a3b1-4d69-9455-d2579416eab2 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:18.369923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5c1f4-a3b1-4d69-9455-d2579416eab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:18.370227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5c1f4-a3b1-4d69-9455-d2579416eab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:18.371825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-42c5c1f4-a3b1-4d69-9455-d2579416eab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:18.476727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:18.478943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5c1f4-a3b1-4d69-9455-d2579416eab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:18.480380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5c1f4-a3b1-4d69-9455-d2579416eab2 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:18.498236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 649/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:20.705674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547b88f-9146-42c6-9181-f6281ea2db2a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:20.706132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547b88f-9146-42c6-9181-f6281ea2db2a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:20.706290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547b88f-9146-42c6-9181-f6281ea2db2a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:20.707934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 680/1329] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:20.713678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9d85b-029e-404d-93a2-bc5495e16075 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:20.714196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9d85b-029e-404d-93a2-bc5495e16075 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:20.714321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9d85b-029e-404d-93a2-bc5495e16075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:20.784799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-30f9d85b-029e-404d-93a2-bc5495e16075 None None] MFA Rules not processed for user `92f50ac3a70a40c081782c0cf02c739f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:20.786041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30f9d85b-029e-404d-93a2-bc5495e16075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:20.887036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 650/1330] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:21.172699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547b88f-9146-42c6-9181-f6281ea2db2a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:21.174294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9547b88f-9146-42c6-9181-f6281ea2db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:21.205228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:21.278626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547b88f-9146-42c6-9181-f6281ea2db2a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:21.350896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d1e86-8c70-4499-b125-5e36aa07b4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:21.351506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d1e86-8c70-4499-b125-5e36aa07b4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.351788 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d1e86-8c70-4499-b125-5e36aa07b4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.352061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d1e86-8c70-4499-b125-5e36aa07b4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.353666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-008d1e86-8c70-4499-b125-5e36aa07b4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:21.433192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:21.466511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d1e86-8c70-4499-b125-5e36aa07b4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:21.468004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d1e86-8c70-4499-b125-5e36aa07b4d1 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:21.486796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 681/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:24.221313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65434b4-55ab-479e-8723-9c63fc08bb3f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.221880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65434b4-55ab-479e-8723-9c63fc08bb3f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.221880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65434b4-55ab-479e-8723-9c63fc08bb3f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.223143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 651/1332] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:24.228945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40ec1d-982a-4b86-986b-8c8482306503 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.229354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40ec1d-982a-4b86-986b-8c8482306503 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.229501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40ec1d-982a-4b86-986b-8c8482306503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.293453 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1e40ec1d-982a-4b86-986b-8c8482306503 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:24.294685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1e40ec1d-982a-4b86-986b-8c8482306503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.388657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 682/1333] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:24.666348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65434b4-55ab-479e-8723-9c63fc08bb3f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.667942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b65434b4-55ab-479e-8723-9c63fc08bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.736982 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:24.770961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65434b4-55ab-479e-8723-9c63fc08bb3f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.843259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bccac0-5012-4501-818a-43df7cabfa27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.843867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bccac0-5012-4501-818a-43df7cabfa27 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.844177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bccac0-5012-4501-818a-43df7cabfa27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.844450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bccac0-5012-4501-818a-43df7cabfa27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.846198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a4bccac0-5012-4501-818a-43df7cabfa27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.952676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bccac0-5012-4501-818a-43df7cabfa27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.954134 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bccac0-5012-4501-818a-43df7cabfa27 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.964062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:24.971966 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 652/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:27.143151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb41f2-6606-496f-8a8c-f6c684a38268 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.143792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb41f2-6606-496f-8a8c-f6c684a38268 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.143792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb41f2-6606-496f-8a8c-f6c684a38268 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.145045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 683/1335] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:27.150990 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9547a04-fbf2-4171-acb4-f3322b8661eb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.151432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9547a04-fbf2-4171-acb4-f3322b8661eb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.151535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9547a04-fbf2-4171-acb4-f3322b8661eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.215921 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f9547a04-fbf2-4171-acb4-f3322b8661eb None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:27.217130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f9547a04-fbf2-4171-acb4-f3322b8661eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:27.310100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 653/1336] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:27.595883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb41f2-6606-496f-8a8c-f6c684a38268 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:27.597441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8edb41f2-6606-496f-8a8c-f6c684a38268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:27.637747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:27.700941 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb41f2-6606-496f-8a8c-f6c684a38268 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:27.773243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2df96-879c-4cc0-9258-ae3fe5f8a6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:27.773855 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2df96-879c-4cc0-9258-ae3fe5f8a6df service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.774175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2df96-879c-4cc0-9258-ae3fe5f8a6df service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.774450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2df96-879c-4cc0-9258-ae3fe5f8a6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.776068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-15c2df96-879c-4cc0-9258-ae3fe5f8a6df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:27.858059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:27.884148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2df96-879c-4cc0-9258-ae3fe5f8a6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:27.885583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2df96-879c-4cc0-9258-ae3fe5f8a6df service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:27.903671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 684/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:30.686464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50229df7-2a29-460f-8631-a6c8180ebe16 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.687028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50229df7-2a29-460f-8631-a6c8180ebe16 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.687028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50229df7-2a29-460f-8631-a6c8180ebe16 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.688366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 654/1338] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:30.693449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5d1b-129e-447a-a08e-69975af1f30b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.693830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5d1b-129e-447a-a08e-69975af1f30b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.694029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5d1b-129e-447a-a08e-69975af1f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.758035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-34cd5d1b-129e-447a-a08e-69975af1f30b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:30.759294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-34cd5d1b-129e-447a-a08e-69975af1f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.852361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 685/1339] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:31.137822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50229df7-2a29-460f-8631-a6c8180ebe16 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:31.139411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-50229df7-2a29-460f-8631-a6c8180ebe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.213046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:31.239445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50229df7-2a29-460f-8631-a6c8180ebe16 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:31.311370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939cd43-894a-4551-8623-dc66e5d2abff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:31.311970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939cd43-894a-4551-8623-dc66e5d2abff service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.312249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939cd43-894a-4551-8623-dc66e5d2abff service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.312516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939cd43-894a-4551-8623-dc66e5d2abff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.314132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b939cd43-894a-4551-8623-dc66e5d2abff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.418592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939cd43-894a-4551-8623-dc66e5d2abff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:31.420016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939cd43-894a-4551-8623-dc66e5d2abff service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:31.437257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 655/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:35.748016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31abc7-bb7c-459a-bec4-b5fe5161f5ac None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.748558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31abc7-bb7c-459a-bec4-b5fe5161f5ac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.748558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31abc7-bb7c-459a-bec4-b5fe5161f5ac None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.749923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 686/1341] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:35.755325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b810-139d-45c5-83d1-483c72dca1c8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.755732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b810-139d-45c5-83d1-483c72dca1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.755930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0b810-139d-45c5-83d1-483c72dca1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.761816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:35.822351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c1d0b810-139d-45c5-83d1-483c72dca1c8 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:35.823548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1d0b810-139d-45c5-83d1-483c72dca1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:35.918982 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 656/1342] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:36.207080 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31abc7-bb7c-459a-bec4-b5fe5161f5ac None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.208641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e31abc7-bb7c-459a-bec4-b5fe5161f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:36.257686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:36.312329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31abc7-bb7c-459a-bec4-b5fe5161f5ac None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.384845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482191-77e3-4630-b665-1a7866cba040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.385449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482191-77e3-4630-b665-1a7866cba040 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.385728 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482191-77e3-4630-b665-1a7866cba040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.385999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482191-77e3-4630-b665-1a7866cba040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.387692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-58482191-77e3-4630-b665-1a7866cba040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:36.480431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:36.496668 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482191-77e3-4630-b665-1a7866cba040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.498712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482191-77e3-4630-b665-1a7866cba040 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.516904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 687/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:39.507413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c55f-27a7-4a5b-86a2-8b15d2e19bc3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.508206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c55f-27a7-4a5b-86a2-8b15d2e19bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.508206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c55f-27a7-4a5b-86a2-8b15d2e19bc3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.509299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 657/1344] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:39.514630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb642e-b14f-40dc-8ced-b21cff0dfa82 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.515058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb642e-b14f-40dc-8ced-b21cff0dfa82 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.515159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb642e-b14f-40dc-8ced-b21cff0dfa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.580207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1cfb642e-b14f-40dc-8ced-b21cff0dfa82 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:39.581709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1cfb642e-b14f-40dc-8ced-b21cff0dfa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:39.682496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 688/1345] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:39.968884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c55f-27a7-4a5b-86a2-8b15d2e19bc3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:39.970525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3207c55f-27a7-4a5b-86a2-8b15d2e19bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:40.058368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:40.074787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c55f-27a7-4a5b-86a2-8b15d2e19bc3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:40.151572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da71a60-e253-4e9d-94e2-362e35577fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:40.152093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da71a60-e253-4e9d-94e2-362e35577fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.152375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da71a60-e253-4e9d-94e2-362e35577fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.152643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da71a60-e253-4e9d-94e2-362e35577fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.154271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0da71a60-e253-4e9d-94e2-362e35577fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:40.264078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da71a60-e253-4e9d-94e2-362e35577fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:40.265516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da71a60-e253-4e9d-94e2-362e35577fd6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.284066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 658/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:44.657524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f490-8634-4730-a130-47766ac30d0c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.657969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f490-8634-4730-a130-47766ac30d0c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.658067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4f490-8634-4730-a130-47766ac30d0c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.659652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 689/1347] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:44.665540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0c97-c3f4-40ad-ae47-33b38fbac243 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.665956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0c97-c3f4-40ad-ae47-33b38fbac243 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.666403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d0c97-c3f4-40ad-ae47-33b38fbac243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.682735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:44.735337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ab6d0c97-c3f4-40ad-ae47-33b38fbac243 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:44.736589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ab6d0c97-c3f4-40ad-ae47-33b38fbac243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.834026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 659/1348] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:45.112521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4f490-8634-4730-a130-47766ac30d0c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:45.114029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b7d4f490-8634-4730-a130-47766ac30d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:45.171572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:45.217208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4f490-8634-4730-a130-47766ac30d0c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:45.289713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef34c3-0fb6-4df8-82f5-1c5b47b51fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:45.290340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef34c3-0fb6-4df8-82f5-1c5b47b51fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:45.290627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef34c3-0fb6-4df8-82f5-1c5b47b51fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:45.290898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef34c3-0fb6-4df8-82f5-1c5b47b51fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:45.292490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c2ef34c3-0fb6-4df8-82f5-1c5b47b51fe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:45.394819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:45.398911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef34c3-0fb6-4df8-82f5-1c5b47b51fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:45.400339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef34c3-0fb6-4df8-82f5-1c5b47b51fe2 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:45.417915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 690/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:50.317524 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007905a7-d820-4286-8668-e6b44180052f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:50.318010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007905a7-d820-4286-8668-e6b44180052f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:50.318010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007905a7-d820-4286-8668-e6b44180052f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:50.320162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 660/1350] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 08:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:50.325925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3d2c-57c9-47f6-818c-66f18b9a9ef0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:50.329543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3d2c-57c9-47f6-818c-66f18b9a9ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:50.330159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f3d2c-57c9-47f6-818c-66f18b9a9ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:50.454942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7b3f3d2c-57c9-47f6-818c-66f18b9a9ef0 None None] MFA Rules not processed for user `efba357340ac47dca0b1742d4e04fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:50.456545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7b3f3d2c-57c9-47f6-818c-66f18b9a9ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:50.577794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 691/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 08:53:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:54.594976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394a4ff-658a-4a7f-86c5-35b1143118a7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.595566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394a4ff-658a-4a7f-86c5-35b1143118a7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.595566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394a4ff-658a-4a7f-86c5-35b1143118a7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.597138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 661/1352] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 08:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:54.602751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3e88-78ab-44e3-a9a0-02fa586c8ef3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.603562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3e88-78ab-44e3-a9a0-02fa586c8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.604059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3e88-78ab-44e3-a9a0-02fa586c8ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.665160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:54.689628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-008d3e88-78ab-44e3-a9a0-02fa586c8ef3 None None] MFA Rules not processed for user `efba357340ac47dca0b1742d4e04fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:54.698659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-008d3e88-78ab-44e3-a9a0-02fa586c8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:54.816437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 692/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:54.832403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=59 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:56.299337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30942acf-12c0-45e8-aa07-7c61ae3fc67b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:56.299944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30942acf-12c0-45e8-aa07-7c61ae3fc67b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:56.299944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30942acf-12c0-45e8-aa07-7c61ae3fc67b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:56.301139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 662/1354] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 08:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:56.306307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526bda7-c110-4e35-b880-ec1172d7d729 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:56.306709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526bda7-c110-4e35-b880-ec1172d7d729 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:56.306968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526bda7-c110-4e35-b880-ec1172d7d729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:56.498325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0526bda7-c110-4e35-b880-ec1172d7d729 None None] MFA Rules not processed for user `efba357340ac47dca0b1742d4e04fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:56.499539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0526bda7-c110-4e35-b880-ec1172d7d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:56.541287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:56.611601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 693/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 08:53:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:00.032098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ed363-bff5-4353-8c79-4f928f8b10b7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.032098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ed363-bff5-4353-8c79-4f928f8b10b7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.032098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ed363-bff5-4353-8c79-4f928f8b10b7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.034199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 663/1356] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:00.039740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb7729-1ed4-4a7c-a419-3417b557ddd7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.040186 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb7729-1ed4-4a7c-a419-3417b557ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.040285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb7729-1ed4-4a7c-a419-3417b557ddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.125837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-93cb7729-1ed4-4a7c-a419-3417b557ddd7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:00.127108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-93cb7729-1ed4-4a7c-a419-3417b557ddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.228460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 694/1357] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:00.528738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fdb13-9a9e-4c1f-aa6b-c8c585d994a3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.529609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fdb13-9a9e-4c1f-aa6b-c8c585d994a3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.530401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fdb13-9a9e-4c1f-aa6b-c8c585d994a3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.535536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 664/1358] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 08:54:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:00.541455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a311c6-7529-4e74-ab2b-b91d83ccc85e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.541748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a311c6-7529-4e74-ab2b-b91d83ccc85e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.542024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a311c6-7529-4e74-ab2b-b91d83ccc85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.563777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:00.630034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-99a311c6-7529-4e74-ab2b-b91d83ccc85e None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:00.631250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-99a311c6-7529-4e74-ab2b-b91d83ccc85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.752653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 695/1359] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 08:54:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:00.760992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fdb13-9a9e-4c1f-aa6b-c8c585d994a3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.763777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bd4fdb13-9a9e-4c1f-aa6b-c8c585d994a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.919963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fdb13-9a9e-4c1f-aa6b-c8c585d994a3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:01.003474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:01.047807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33315611-fdf8-4b39-8db5-388464c94844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.048426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33315611-fdf8-4b39-8db5-388464c94844 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.048689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33315611-fdf8-4b39-8db5-388464c94844 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.048960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33315611-fdf8-4b39-8db5-388464c94844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.050607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-33315611-fdf8-4b39-8db5-388464c94844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:01.153647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33315611-fdf8-4b39-8db5-388464c94844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.155676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33315611-fdf8-4b39-8db5-388464c94844 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:01.179559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 665/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:03.549149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ef7a-fafd-4c38-a84e-7d8e73181b3f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:03.549704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ef7a-fafd-4c38-a84e-7d8e73181b3f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:03.549704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ef7a-fafd-4c38-a84e-7d8e73181b3f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:03.551089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 696/1361] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:03.557195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261f4db-3bde-4133-bdaf-829c941ae2a3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:03.561282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261f4db-3bde-4133-bdaf-829c941ae2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:03.561282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261f4db-3bde-4133-bdaf-829c941ae2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:03.627190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6261f4db-3bde-4133-bdaf-829c941ae2a3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:03.629424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6261f4db-3bde-4133-bdaf-829c941ae2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:03.676001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:03.754132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 666/1362] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:04.040094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8ef7a-fafd-4c38-a84e-7d8e73181b3f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:04.041624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ba8ef7a-fafd-4c38-a84e-7d8e73181b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:04.117091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:04.213546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8ef7a-fafd-4c38-a84e-7d8e73181b3f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:04.360113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87bb56-8ffa-4598-8ee1-97e7cf405f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:04.360909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87bb56-8ffa-4598-8ee1-97e7cf405f76 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:04.361367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87bb56-8ffa-4598-8ee1-97e7cf405f76 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:04.361757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87bb56-8ffa-4598-8ee1-97e7cf405f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:04.363836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1c87bb56-8ffa-4598-8ee1-97e7cf405f76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:04.391828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:04.474602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87bb56-8ffa-4598-8ee1-97e7cf405f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:04.476154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87bb56-8ffa-4598-8ee1-97e7cf405f76 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:04.494988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 697/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:07.098583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686e01c-77d4-4be7-9916-834803c14572 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.099437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686e01c-77d4-4be7-9916-834803c14572 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.099725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686e01c-77d4-4be7-9916-834803c14572 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.105096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 667/1364] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:07.106788 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279121-f048-41f7-a0b2-dd5295610571 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.107233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279121-f048-41f7-a0b2-dd5295610571 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.107327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279121-f048-41f7-a0b2-dd5295610571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.181755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ef279121-f048-41f7-a0b2-dd5295610571 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:07.182991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef279121-f048-41f7-a0b2-dd5295610571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.284369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:07.291083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 698/1365] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:07.585665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3badd84-ea2d-48d8-9f57-e73975c16e97 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.585951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3badd84-ea2d-48d8-9f57-e73975c16e97 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.586265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3badd84-ea2d-48d8-9f57-e73975c16e97 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.587759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 668/1366] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 08:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:07.598217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1345bdf-c497-4f72-a600-d250a756587d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.598683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1345bdf-c497-4f72-a600-d250a756587d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.598964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1345bdf-c497-4f72-a600-d250a756587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.679216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c1345bdf-c497-4f72-a600-d250a756587d None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:07.680811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c1345bdf-c497-4f72-a600-d250a756587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.809232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 699/1367] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:07.817734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3badd84-ea2d-48d8-9f57-e73975c16e97 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:07.819575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a3badd84-ea2d-48d8-9f57-e73975c16e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.985063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3badd84-ea2d-48d8-9f57-e73975c16e97 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.007148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:08.109203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e342fd-93db-4868-9556-34b66c8b1fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.109910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e342fd-93db-4868-9556-34b66c8b1fab service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.110210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e342fd-93db-4868-9556-34b66c8b1fab service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.110388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e342fd-93db-4868-9556-34b66c8b1fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.112385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-62e342fd-93db-4868-9556-34b66c8b1fab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.211460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e342fd-93db-4868-9556-34b66c8b1fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.212976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e342fd-93db-4868-9556-34b66c8b1fab service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.232114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 669/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:08.234855 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d91b3-2ee6-4c68-83c7-3b885401113b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.235345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d91b3-2ee6-4c68-83c7-3b885401113b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.235429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d91b3-2ee6-4c68-83c7-3b885401113b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.237035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 700/1369] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:08.242386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1b96-8e56-4603-aadf-a348830db07b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.242675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1b96-8e56-4603-aadf-a348830db07b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.242949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1b96-8e56-4603-aadf-a348830db07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.275669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:08.309833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e51e1b96-8e56-4603-aadf-a348830db07b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:08.311076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e51e1b96-8e56-4603-aadf-a348830db07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.421935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 670/1370] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:08.757547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d67bf2-c211-42cf-9d4a-4e45e2f56497 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.757547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d67bf2-c211-42cf-9d4a-4e45e2f56497 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.757547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d67bf2-c211-42cf-9d4a-4e45e2f56497 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.759352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 701/1371] 10.222.0.33 () {54 vars in 963 bytes} [Tue Oct 4 08:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:08.763897 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437178e4-557a-4b79-b29b-466e868c4d4a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.764183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437178e4-557a-4b79-b29b-466e868c4d4a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.764456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437178e4-557a-4b79-b29b-466e868c4d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.847021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-437178e4-557a-4b79-b29b-466e868c4d4a None None] MFA Rules not processed for user `d4f8f6b881a9476bb0951bc68d17ca70`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:08.848701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-437178e4-557a-4b79-b29b-466e868c4d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.903587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:08.940583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 671/1372] 10.222.0.33 () {58 vars in 1060 bytes} [Tue Oct 4 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:08.948702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d67bf2-c211-42cf-9d4a-4e45e2f56497 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.950257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-80d67bf2-c211-42cf-9d4a-4e45e2f56497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:09.008485 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:09.063649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d67bf2-c211-42cf-9d4a-4e45e2f56497 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:09.144429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f03e9-4a7f-4bde-a35a-403a2e8e0cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:09.145691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f03e9-4a7f-4bde-a35a-403a2e8e0cae service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:09.145983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f03e9-4a7f-4bde-a35a-403a2e8e0cae service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:09.146476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f03e9-4a7f-4bde-a35a-403a2e8e0cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:09.148129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ca2f03e9-4a7f-4bde-a35a-403a2e8e0cae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:09.248341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:09.262382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f03e9-4a7f-4bde-a35a-403a2e8e0cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:09.263767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f03e9-4a7f-4bde-a35a-403a2e8e0cae service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:09.284194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 702/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:10.618587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d67eed-c772-41cc-b016-6c26544c9271 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:10.619148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d67eed-c772-41cc-b016-6c26544c9271 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:10.619148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d67eed-c772-41cc-b016-6c26544c9271 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:10.620483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 672/1374] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:10.625864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f2575-c34b-4fe9-a386-18e22d542e7c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:10.626304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f2575-c34b-4fe9-a386-18e22d542e7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:10.626450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f2575-c34b-4fe9-a386-18e22d542e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:10.694129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-176f2575-c34b-4fe9-a386-18e22d542e7c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:10.695428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-176f2575-c34b-4fe9-a386-18e22d542e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:10.792538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 703/1375] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:11.086364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d67eed-c772-41cc-b016-6c26544c9271 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:11.087926 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d7d67eed-c772-41cc-b016-6c26544c9271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:11.234654 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d67eed-c772-41cc-b016-6c26544c9271 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:11.290757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:11.363332 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d4a7e-6933-40ad-b60d-312ee938fb69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:11.364511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4a7e-6933-40ad-b60d-312ee938fb69 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:11.364788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4a7e-6933-40ad-b60d-312ee938fb69 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:11.365051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4a7e-6933-40ad-b60d-312ee938fb69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:11.366678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f13d4a7e-6933-40ad-b60d-312ee938fb69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:11.458768 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d4a7e-6933-40ad-b60d-312ee938fb69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:11.460373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d4a7e-6933-40ad-b60d-312ee938fb69 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:11.479697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 673/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:13.782972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8f849-b20e-4e05-8f2f-928f2aad7aef None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:13.783506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8f849-b20e-4e05-8f2f-928f2aad7aef None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:13.783506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8f849-b20e-4e05-8f2f-928f2aad7aef None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:13.785035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 704/1377] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:13.790286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b7580-9199-462a-b9cc-1ee766ad83b4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:13.790715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b7580-9199-462a-b9cc-1ee766ad83b4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:13.790836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b7580-9199-462a-b9cc-1ee766ad83b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:13.856896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8a4b7580-9199-462a-b9cc-1ee766ad83b4 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:13.858116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8a4b7580-9199-462a-b9cc-1ee766ad83b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:13.865528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:13.966322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 674/1378] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:14.255465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8f849-b20e-4e05-8f2f-928f2aad7aef None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:14.257107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-48b8f849-b20e-4e05-8f2f-928f2aad7aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:14.321719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:14.413041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8f849-b20e-4e05-8f2f-928f2aad7aef None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:14.543993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeef284-218b-452d-8d0c-9e9c1927fe6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:14.544965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeef284-218b-452d-8d0c-9e9c1927fe6b service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:14.545457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeef284-218b-452d-8d0c-9e9c1927fe6b service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:14.545831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeef284-218b-452d-8d0c-9e9c1927fe6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:14.547621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bbeef284-218b-452d-8d0c-9e9c1927fe6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:14.570359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:14.648667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeef284-218b-452d-8d0c-9e9c1927fe6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:14.650297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeef284-218b-452d-8d0c-9e9c1927fe6b service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:14.670445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 705/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:16.990966 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0a17-5a7f-460f-9f2a-440aaf7ba2b8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:16.991532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0a17-5a7f-460f-9f2a-440aaf7ba2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:16.991532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0a17-5a7f-460f-9f2a-440aaf7ba2b8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:16.992881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 675/1380] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:16.998133 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41d4e9-2666-44e9-83a2-f89d85296cea None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:16.998536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41d4e9-2666-44e9-83a2-f89d85296cea None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:16.998696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41d4e9-2666-44e9-83a2-f89d85296cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:17.069355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ee41d4e9-2666-44e9-83a2-f89d85296cea None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:17.070710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ee41d4e9-2666-44e9-83a2-f89d85296cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:17.161918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:17.167601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 706/1381] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:17.455754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a0a17-5a7f-460f-9f2a-440aaf7ba2b8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:17.458424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-926a0a17-5a7f-460f-9f2a-440aaf7ba2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:17.605361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:17.612427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a0a17-5a7f-460f-9f2a-440aaf7ba2b8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:17.723882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f4a1e-fc1b-40de-bfb9-6cf37f2342e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:17.724411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f4a1e-fc1b-40de-bfb9-6cf37f2342e1 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:17.724691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f4a1e-fc1b-40de-bfb9-6cf37f2342e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:17.724962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f4a1e-fc1b-40de-bfb9-6cf37f2342e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:17.726775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9b1f4a1e-fc1b-40de-bfb9-6cf37f2342e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:17.814776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f4a1e-fc1b-40de-bfb9-6cf37f2342e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:17.816415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f4a1e-fc1b-40de-bfb9-6cf37f2342e1 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:17.826146 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:17.834649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 676/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:20.167091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbbc75-42f5-45d2-8ed8-2df8bbcaea65 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:20.167647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbbc75-42f5-45d2-8ed8-2df8bbcaea65 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:20.167810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbbc75-42f5-45d2-8ed8-2df8bbcaea65 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:20.169546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 707/1383] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:20.176279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8df74-8c13-4f1d-a14c-4bcf13fb67d4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:20.176707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8df74-8c13-4f1d-a14c-4bcf13fb67d4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:20.176834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8df74-8c13-4f1d-a14c-4bcf13fb67d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:20.246052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-11f8df74-8c13-4f1d-a14c-4bcf13fb67d4 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:20.247198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-11f8df74-8c13-4f1d-a14c-4bcf13fb67d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:20.342296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 677/1384] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:20.636784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbbc75-42f5-45d2-8ed8-2df8bbcaea65 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:20.639326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2efbbc75-42f5-45d2-8ed8-2df8bbcaea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:20.785567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbbc75-42f5-45d2-8ed8-2df8bbcaea65 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:20.853607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:20.900302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d911c3e-45e6-4a97-9f6f-f31746b0177b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:20.900769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911c3e-45e6-4a97-9f6f-f31746b0177b service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:20.901049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911c3e-45e6-4a97-9f6f-f31746b0177b service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:20.901318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911c3e-45e6-4a97-9f6f-f31746b0177b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:20.902955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5d911c3e-45e6-4a97-9f6f-f31746b0177b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:20.994076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d911c3e-45e6-4a97-9f6f-f31746b0177b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:20.995651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d911c3e-45e6-4a97-9f6f-f31746b0177b service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:21.014457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 708/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:23.410759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e91b6a-4afe-4c6f-b454-5c01a1cb2c4d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:23.411322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e91b6a-4afe-4c6f-b454-5c01a1cb2c4d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:23.411322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e91b6a-4afe-4c6f-b454-5c01a1cb2c4d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:23.412707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 678/1386] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:23.418073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580ab31-0021-4948-821b-7dab10fa8021 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:23.418538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580ab31-0021-4948-821b-7dab10fa8021 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:23.418796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580ab31-0021-4948-821b-7dab10fa8021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:23.483376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d580ab31-0021-4948-821b-7dab10fa8021 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:23.484571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d580ab31-0021-4948-821b-7dab10fa8021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:23.518033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:23.581085 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 709/1387] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:23.868144 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e91b6a-4afe-4c6f-b454-5c01a1cb2c4d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:23.869675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-47e91b6a-4afe-4c6f-b454-5c01a1cb2c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:23.948828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:24.024638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e91b6a-4afe-4c6f-b454-5c01a1cb2c4d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:24.135351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75c6b4-3567-4ff4-931b-5bc2e970ed4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:24.135955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c6b4-3567-4ff4-931b-5bc2e970ed4d service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.136230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c6b4-3567-4ff4-931b-5bc2e970ed4d service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.136497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c6b4-3567-4ff4-931b-5bc2e970ed4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.138074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5c75c6b4-3567-4ff4-931b-5bc2e970ed4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:24.177286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:24.228779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75c6b4-3567-4ff4-931b-5bc2e970ed4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:24.230419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75c6b4-3567-4ff4-931b-5bc2e970ed4d service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:24.247944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 679/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:24.633807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86350e80-407a-43c9-be6c-747c3a3c4629 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.635469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86350e80-407a-43c9-be6c-747c3a3c4629 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.635747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86350e80-407a-43c9-be6c-747c3a3c4629 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.637202 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 710/1389] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:24.642478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd4515-9a47-46fe-8beb-ad4147ecef5d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.642887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd4515-9a47-46fe-8beb-ad4147ecef5d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.642989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd4515-9a47-46fe-8beb-ad4147ecef5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.709335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f6bd4515-9a47-46fe-8beb-ad4147ecef5d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:24.710589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6bd4515-9a47-46fe-8beb-ad4147ecef5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:24.816007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 680/1390] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:25.118845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937610-8a30-4f3e-b564-c136d372b091 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.119132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937610-8a30-4f3e-b564-c136d372b091 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.119433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937610-8a30-4f3e-b564-c136d372b091 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.120806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 711/1391] 10.222.0.33 () {54 vars in 962 bytes} [Tue Oct 4 08:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:25.126059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdddc0-83b7-48a5-ac10-2f89fa7c6a49 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.126386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdddc0-83b7-48a5-ac10-2f89fa7c6a49 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.126669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdddc0-83b7-48a5-ac10-2f89fa7c6a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.143034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:25.205635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7afdddc0-83b7-48a5-ac10-2f89fa7c6a49 None None] MFA Rules not processed for user `8a8339b6461e4e28bc397dcd3f85e1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:25.206828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7afdddc0-83b7-48a5-ac10-2f89fa7c6a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:25.283772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 681/1392] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Oct 4 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:25.292137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f937610-8a30-4f3e-b564-c136d372b091 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:25.293758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6f937610-8a30-4f3e-b564-c136d372b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:25.400260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f937610-8a30-4f3e-b564-c136d372b091 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:25.458811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:25.476246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86766384-6c49-46ae-b04a-96a78b625893 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8339b6461e4e28bc397dcd3f85e1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:25.478162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86766384-6c49-46ae-b04a-96a78b625893 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.478162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86766384-6c49-46ae-b04a-96a78b625893 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.478162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86766384-6c49-46ae-b04a-96a78b625893 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.479341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-86766384-6c49-46ae-b04a-96a78b625893 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:25.590883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86766384-6c49-46ae-b04a-96a78b625893 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:25.592503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86766384-6c49-46ae-b04a-96a78b625893 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:25.614029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 712/1393] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:26.492767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bfba9-6ff2-4251-b66d-7e4d521177c6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:26.493269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bfba9-6ff2-4251-b66d-7e4d521177c6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:26.493568 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bfba9-6ff2-4251-b66d-7e4d521177c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:26.560876 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-130bfba9-6ff2-4251-b66d-7e4d521177c6 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:26.562122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-130bfba9-6ff2-4251-b66d-7e4d521177c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:26.619507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:26.651447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 682/1394] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 08:54:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:26.696283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a209-e736-4c15-a224-17ee0d98a6fa None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:26.696753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a209-e736-4c15-a224-17ee0d98a6fa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:26.696859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a209-e736-4c15-a224-17ee0d98a6fa None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:26.698337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 713/1395] 10.222.0.33 () {54 vars in 943 bytes} [Tue Oct 4 08:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:26.705596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f7450-b85b-476a-84d9-3f98395e3145 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:26.707054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f7450-b85b-476a-84d9-3f98395e3145 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:26.707054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f7450-b85b-476a-84d9-3f98395e3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:26.788199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ff7f7450-b85b-476a-84d9-3f98395e3145 None None] MFA Rules not processed for user `88353e858ec64a9cbdcfd16dbc00ebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:26.789406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ff7f7450-b85b-476a-84d9-3f98395e3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:26.827735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77f6b3-77ef-4c08-92fc-fe3d64719d2a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:26.828075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77f6b3-77ef-4c08-92fc-fe3d64719d2a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:26.828368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77f6b3-77ef-4c08-92fc-fe3d64719d2a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:26.829882 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 714/1396] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:54:26.835389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41187556-082d-4f31-8d74-738f7f1ebfc0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:26.835671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41187556-082d-4f31-8d74-738f7f1ebfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:26.835944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41187556-082d-4f31-8d74-738f7f1ebfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:26.900966 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 683/1397] 10.222.0.33 () {58 vars in 1040 bytes} [Tue Oct 4 08:54:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:26.902555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-41187556-082d-4f31-8d74-738f7f1ebfc0 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:26.903761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-41187556-082d-4f31-8d74-738f7f1ebfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:26.911576 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f7450-b85b-476a-84d9-3f98395e3145 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:26.921257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f7450-b85b-476a-84d9-3f98395e3145 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:26.946677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:26.949000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:27.006463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 715/1398] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:27.025776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b48fee-ff4f-4722-894e-f11bd591d584 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:27.026419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b48fee-ff4f-4722-894e-f11bd591d584 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:27.026699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b48fee-ff4f-4722-894e-f11bd591d584 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:27.026968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b48fee-ff4f-4722-894e-f11bd591d584 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:27.028646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-31b48fee-ff4f-4722-894e-f11bd591d584 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:27.110867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b48fee-ff4f-4722-894e-f11bd591d584 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:27.112478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b48fee-ff4f-4722-894e-f11bd591d584 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:27.120532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 684/1399] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 08:54:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:54:27.300392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41187556-082d-4f31-8d74-738f7f1ebfc0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:27.301620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-41187556-082d-4f31-8d74-738f7f1ebfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:27.414523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41187556-082d-4f31-8d74-738f7f1ebfc0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:27.470574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:27.533014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f38c0-9595-43ab-93ca-e8fbdd8e62cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:27.537589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f38c0-9595-43ab-93ca-e8fbdd8e62cf service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:27.537589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f38c0-9595-43ab-93ca-e8fbdd8e62cf service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:27.537589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f38c0-9595-43ab-93ca-e8fbdd8e62cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:27.537589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a13f38c0-9595-43ab-93ca-e8fbdd8e62cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:27.640652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f38c0-9595-43ab-93ca-e8fbdd8e62cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:27.642292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f38c0-9595-43ab-93ca-e8fbdd8e62cf service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:27.662669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 716/1400] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:29.986305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d9ba-1c7b-43fe-a312-88fa60aca936 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:29.986835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d9ba-1c7b-43fe-a312-88fa60aca936 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:29.986943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d9ba-1c7b-43fe-a312-88fa60aca936 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:29.988253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 685/1401] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:29.993547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09771-919f-4898-a3b5-fe835d14691d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:29.993992 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09771-919f-4898-a3b5-fe835d14691d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:29.994116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09771-919f-4898-a3b5-fe835d14691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:30.069981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-82e09771-919f-4898-a3b5-fe835d14691d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:30.071381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-82e09771-919f-4898-a3b5-fe835d14691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:30.088541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:30.181285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 717/1402] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:30.505853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5d9ba-1c7b-43fe-a312-88fa60aca936 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:30.508169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-72a5d9ba-1c7b-43fe-a312-88fa60aca936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:30.578343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:30.672355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5d9ba-1c7b-43fe-a312-88fa60aca936 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:30.806098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12a71a-5179-448d-b134-667bf52dee47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:30.806643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12a71a-5179-448d-b134-667bf52dee47 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:30.806927 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12a71a-5179-448d-b134-667bf52dee47 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:30.807198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12a71a-5179-448d-b134-667bf52dee47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:30.808868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4e12a71a-5179-448d-b134-667bf52dee47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:30.833387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:30.917804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12a71a-5179-448d-b134-667bf52dee47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:30.919495 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12a71a-5179-448d-b134-667bf52dee47 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:30.950292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 686/1403] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:33.241234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529fc1-4cf9-4cba-9335-7be459e8e4c4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:33.241784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529fc1-4cf9-4cba-9335-7be459e8e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:33.241784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529fc1-4cf9-4cba-9335-7be459e8e4c4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:33.247098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 718/1404] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:33.248853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e659a-c93e-42c8-a375-aa39cfaa9b2f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:33.249319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e659a-c93e-42c8-a375-aa39cfaa9b2f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:33.249410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e659a-c93e-42c8-a375-aa39cfaa9b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:33.321673 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8c7e659a-c93e-42c8-a375-aa39cfaa9b2f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:33.322934 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8c7e659a-c93e-42c8-a375-aa39cfaa9b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:33.421738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:33.433141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 687/1405] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:33.720881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f529fc1-4cf9-4cba-9335-7be459e8e4c4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:33.722810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7f529fc1-4cf9-4cba-9335-7be459e8e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:33.883761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:33.886559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f529fc1-4cf9-4cba-9335-7be459e8e4c4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:34.013918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f11f3f-073b-463a-8a77-763b002a7085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:34.014566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f11f3f-073b-463a-8a77-763b002a7085 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:34.014843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f11f3f-073b-463a-8a77-763b002a7085 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:34.015111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f11f3f-073b-463a-8a77-763b002a7085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:34.016743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-93f11f3f-073b-463a-8a77-763b002a7085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:34.113210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f11f3f-073b-463a-8a77-763b002a7085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:34.114901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f11f3f-073b-463a-8a77-763b002a7085 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:34.135396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 719/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:36.540164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c3985-47ec-4307-b7df-4c86fad10fdd None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:36.540736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c3985-47ec-4307-b7df-4c86fad10fdd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:36.540736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c3985-47ec-4307-b7df-4c86fad10fdd None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:36.542172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 688/1407] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:36.547496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6e742-b1c4-48d4-b08c-0a2f33246450 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:36.547946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6e742-b1c4-48d4-b08c-0a2f33246450 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:36.548052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6e742-b1c4-48d4-b08c-0a2f33246450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:36.553149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:36.624674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eee6e742-b1c4-48d4-b08c-0a2f33246450 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:36.626173 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eee6e742-b1c4-48d4-b08c-0a2f33246450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:36.734591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 720/1408] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:37.025065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c3985-47ec-4307-b7df-4c86fad10fdd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:37.026630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-354c3985-47ec-4307-b7df-4c86fad10fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:37.188316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c3985-47ec-4307-b7df-4c86fad10fdd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:37.262808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:37.313314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e1aa5-7853-413e-846b-2004a44e4e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:37.314035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1aa5-7853-413e-846b-2004a44e4e4f service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:37.314345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1aa5-7853-413e-846b-2004a44e4e4f service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:37.314644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e1aa5-7853-413e-846b-2004a44e4e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:37.317639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d67e1aa5-7853-413e-846b-2004a44e4e4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:37.414960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e1aa5-7853-413e-846b-2004a44e4e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:37.417051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e1aa5-7853-413e-846b-2004a44e4e4f service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:37.436493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 689/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:46.732771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=64 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:47.433716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=64 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:51.068732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834289e2-5aa4-4e2a-8d14-34e7d91fdfb2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:51.069324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834289e2-5aa4-4e2a-8d14-34e7d91fdfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:51.069324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834289e2-5aa4-4e2a-8d14-34e7d91fdfb2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:51.070652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 721/1410] 10.222.0.33 () {54 vars in 918 bytes} [Tue Oct 4 08:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:51.075727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f18a9-a2f1-4257-b96c-6dac3456f9fb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:51.076160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f18a9-a2f1-4257-b96c-6dac3456f9fb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:51.076284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f18a9-a2f1-4257-b96c-6dac3456f9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:51.150311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e15f18a9-a2f1-4257-b96c-6dac3456f9fb None None] MFA Rules not processed for user `efba357340ac47dca0b1742d4e04fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:51.151516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e15f18a9-a2f1-4257-b96c-6dac3456f9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:51.255619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 690/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Oct 4 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:51.269744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440fb6-f831-4195-a4f7-ae029083efd0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:51.270030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440fb6-f831-4195-a4f7-ae029083efd0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:51.270355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440fb6-f831-4195-a4f7-ae029083efd0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:51.271682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 722/1412] 10.222.0.33 () {54 vars in 918 bytes} [Tue Oct 4 08:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:51.276291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a7edd-3106-43ec-9190-6b0175411fcd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:51.276581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a7edd-3106-43ec-9190-6b0175411fcd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:51.276856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a7edd-3106-43ec-9190-6b0175411fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:51.348750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:51.351279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b29a7edd-3106-43ec-9190-6b0175411fcd None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:51.352472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b29a7edd-3106-43ec-9190-6b0175411fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:51.464299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 691/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Oct 4 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:54.014113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554c4cf-8440-4413-af10-5afeac3c43e2 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:54.014661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554c4cf-8440-4413-af10-5afeac3c43e2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:54.014791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554c4cf-8440-4413-af10-5afeac3c43e2 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:54.016188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 723/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:54.021602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e5c95-be56-4e01-bbb2-12d2077f8b58 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:54.022118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e5c95-be56-4e01-bbb2-12d2077f8b58 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:54.022276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e5c95-be56-4e01-bbb2-12d2077f8b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:54.088040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-890e5c95-be56-4e01-bbb2-12d2077f8b58 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:54.089242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-890e5c95-be56-4e01-bbb2-12d2077f8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:54.142574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:54.182860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 692/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:54.466774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554c4cf-8440-4413-af10-5afeac3c43e2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:54.468305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1554c4cf-8440-4413-af10-5afeac3c43e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:54.611842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554c4cf-8440-4413-af10-5afeac3c43e2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:54.681790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:54.724428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ead22-31e1-4dbd-9ae7-69fe7bb6795b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:54.724958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ead22-31e1-4dbd-9ae7-69fe7bb6795b service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:54.725249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ead22-31e1-4dbd-9ae7-69fe7bb6795b service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:54.725507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ead22-31e1-4dbd-9ae7-69fe7bb6795b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:54.727143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0d3ead22-31e1-4dbd-9ae7-69fe7bb6795b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:54.815706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ead22-31e1-4dbd-9ae7-69fe7bb6795b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:54.817300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ead22-31e1-4dbd-9ae7-69fe7bb6795b service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:54.835708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 724/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:55.958501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec240ee-1fa7-4375-ae45-3bc06aac3dcf None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:55.958982 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec240ee-1fa7-4375-ae45-3bc06aac3dcf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:55.959086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec240ee-1fa7-4375-ae45-3bc06aac3dcf None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:55.960476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 693/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:55.966641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86822-f231-4164-b40a-3dc64aecef98 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:55.967036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86822-f231-4164-b40a-3dc64aecef98 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:55.967191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86822-f231-4164-b40a-3dc64aecef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:56.041309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ffe86822-f231-4164-b40a-3dc64aecef98 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:56.042529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ffe86822-f231-4164-b40a-3dc64aecef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:56.070064 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:56.145102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 725/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:56.303544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec240ee-1fa7-4375-ae45-3bc06aac3dcf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:56.305115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4ec240ee-1fa7-4375-ae45-3bc06aac3dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:56.448853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec240ee-1fa7-4375-ae45-3bc06aac3dcf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:56.488728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:56.561103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159d7c2-93a7-4465-9536-6691f245ead4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:56.561730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d7c2-93a7-4465-9536-6691f245ead4 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:56.562017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d7c2-93a7-4465-9536-6691f245ead4 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:56.562323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d7c2-93a7-4465-9536-6691f245ead4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:56.563937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0159d7c2-93a7-4465-9536-6691f245ead4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:56.653181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159d7c2-93a7-4465-9536-6691f245ead4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:56.654863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159d7c2-93a7-4465-9536-6691f245ead4 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:56.673375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 694/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:57.781513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3808-f825-4563-8769-95ccf7246e80 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:57.782074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3808-f825-4563-8769-95ccf7246e80 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:57.782074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb3808-f825-4563-8769-95ccf7246e80 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:57.783461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 726/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:57.789414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3e88d-a277-4334-ab70-f2eb95d13f96 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:57.789892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3e88d-a277-4334-ab70-f2eb95d13f96 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:57.790052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3e88d-a277-4334-ab70-f2eb95d13f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:57.843856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:57.865099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-58c3e88d-a277-4334-ab70-f2eb95d13f96 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:57.866325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-58c3e88d-a277-4334-ab70-f2eb95d13f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:57.960426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 695/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:58.108583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3808-f825-4563-8769-95ccf7246e80 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:58.110131 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3cdb3808-f825-4563-8769-95ccf7246e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:58.250913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb3808-f825-4563-8769-95ccf7246e80 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:58.262359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:58.361025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf5ea9-79a5-4758-aace-15b75e8d066b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:58.361641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf5ea9-79a5-4758-aace-15b75e8d066b service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:58.361919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf5ea9-79a5-4758-aace-15b75e8d066b service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:58.362214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf5ea9-79a5-4758-aace-15b75e8d066b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:58.363797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-17cf5ea9-79a5-4758-aace-15b75e8d066b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:58.449227 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf5ea9-79a5-4758-aace-15b75e8d066b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:58.450840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf5ea9-79a5-4758-aace-15b75e8d066b service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:58.468815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 727/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:59.564791 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68370-aab2-4031-aad0-831cc8a3df31 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:59.565355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68370-aab2-4031-aad0-831cc8a3df31 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:59.565355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68370-aab2-4031-aad0-831cc8a3df31 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:59.566766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 696/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:59.573121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12c66-0ccd-48d7-887b-0f91d47c1368 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:59.573565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12c66-0ccd-48d7-887b-0f91d47c1368 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:59.573673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12c66-0ccd-48d7-887b-0f91d47c1368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:59.593533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:59.649160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6cb12c66-0ccd-48d7-887b-0f91d47c1368 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:59.650405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6cb12c66-0ccd-48d7-887b-0f91d47c1368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:59.745454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 728/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:59.893923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc68370-aab2-4031-aad0-831cc8a3df31 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:59.895505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0fc68370-aab2-4031-aad0-831cc8a3df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:00.003452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:00.041562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc68370-aab2-4031-aad0-831cc8a3df31 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:00.152218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a258fdd-9952-4e86-a748-6d23c084dde2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:00.152759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258fdd-9952-4e86-a748-6d23c084dde2 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.153042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258fdd-9952-4e86-a748-6d23c084dde2 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.153317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258fdd-9952-4e86-a748-6d23c084dde2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.155058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8a258fdd-9952-4e86-a748-6d23c084dde2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:00.232461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:00.245500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a258fdd-9952-4e86-a748-6d23c084dde2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:00.247133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a258fdd-9952-4e86-a748-6d23c084dde2 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:00.265334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 697/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:01.367381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7988b11-878e-443f-ac0b-4b81a61fc88d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:01.367904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7988b11-878e-443f-ac0b-4b81a61fc88d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:01.368030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7988b11-878e-443f-ac0b-4b81a61fc88d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:01.369291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 729/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:01.375566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e27b-4064-4598-90a1-787d69319094 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:01.375975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e27b-4064-4598-90a1-787d69319094 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:01.376116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e27b-4064-4598-90a1-787d69319094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:01.450327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bdb7e27b-4064-4598-90a1-787d69319094 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:01.451550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bdb7e27b-4064-4598-90a1-787d69319094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:01.546895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 698/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:01.697649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7988b11-878e-443f-ac0b-4b81a61fc88d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:01.699282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d7988b11-878e-443f-ac0b-4b81a61fc88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:01.781786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:01.842982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7988b11-878e-443f-ac0b-4b81a61fc88d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:01.953129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1bbef-9a27-459f-b2c1-58d9aac96750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:01.953729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1bbef-9a27-459f-b2c1-58d9aac96750 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:01.954006 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1bbef-9a27-459f-b2c1-58d9aac96750 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:01.954302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1bbef-9a27-459f-b2c1-58d9aac96750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:01.956536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b8a1bbef-9a27-459f-b2c1-58d9aac96750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:02.004012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:02.044438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1bbef-9a27-459f-b2c1-58d9aac96750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:02.046259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1bbef-9a27-459f-b2c1-58d9aac96750 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:02.065238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 730/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:03.173811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890dbde-721c-4540-b193-9a9e1731a2f1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.174367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890dbde-721c-4540-b193-9a9e1731a2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.174367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890dbde-721c-4540-b193-9a9e1731a2f1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.175748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 699/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:03.181909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b36e-b520-45c7-9b1e-c66aa4293e8f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.182367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b36e-b520-45c7-9b1e-c66aa4293e8f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.182485 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7b36e-b520-45c7-9b1e-c66aa4293e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.257472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e0c7b36e-b520-45c7-9b1e-c66aa4293e8f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:03.258634 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e0c7b36e-b520-45c7-9b1e-c66aa4293e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:03.351543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 731/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:03.500486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890dbde-721c-4540-b193-9a9e1731a2f1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.502073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f890dbde-721c-4540-b193-9a9e1731a2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:03.551272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:03.647816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890dbde-721c-4540-b193-9a9e1731a2f1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:03.757772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2230a-29a0-4fa4-ba27-9023c2430e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:03.758407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2230a-29a0-4fa4-ba27-9023c2430e77 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.758690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2230a-29a0-4fa4-ba27-9023c2430e77 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.758964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2230a-29a0-4fa4-ba27-9023c2430e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.760584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d9a2230a-29a0-4fa4-ba27-9023c2430e77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:03.767323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:03.850135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2230a-29a0-4fa4-ba27-9023c2430e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:03.851661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2230a-29a0-4fa4-ba27-9023c2430e77 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:03.868921 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 700/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:04.993989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222017df-0606-42aa-b7a2-1f8eda79e528 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:04.994536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222017df-0606-42aa-b7a2-1f8eda79e528 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:04.994634 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222017df-0606-42aa-b7a2-1f8eda79e528 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:04.995909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 732/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:05.002556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd9702-98ed-469e-a34c-2aa6e5adcb60 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.002951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd9702-98ed-469e-a34c-2aa6e5adcb60 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.003105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd9702-98ed-469e-a34c-2aa6e5adcb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.076241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dffd9702-98ed-469e-a34c-2aa6e5adcb60 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:05.077453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dffd9702-98ed-469e-a34c-2aa6e5adcb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:05.143481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:05.171017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 701/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:05.318311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222017df-0606-42aa-b7a2-1f8eda79e528 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.319780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-222017df-0606-42aa-b7a2-1f8eda79e528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:05.337169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:05.463009 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222017df-0606-42aa-b7a2-1f8eda79e528 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.548313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:05.574069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197d82c-2bef-4452-8b72-8efcf6d851f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.574653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197d82c-2bef-4452-8b72-8efcf6d851f0 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.574934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197d82c-2bef-4452-8b72-8efcf6d851f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.575204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197d82c-2bef-4452-8b72-8efcf6d851f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.576802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4197d82c-2bef-4452-8b72-8efcf6d851f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:05.664213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197d82c-2bef-4452-8b72-8efcf6d851f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.665804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197d82c-2bef-4452-8b72-8efcf6d851f0 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.683857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 733/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:06.816121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadf76f-6c40-4f64-98a3-26b8059c49a2 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.816703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadf76f-6c40-4f64-98a3-26b8059c49a2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.816703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadf76f-6c40-4f64-98a3-26b8059c49a2 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.818032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 702/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:06.824023 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2369fac-db6c-4564-bb72-2d9e5c472c3f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.824476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2369fac-db6c-4564-bb72-2d9e5c472c3f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.824582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2369fac-db6c-4564-bb72-2d9e5c472c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.899268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c2369fac-db6c-4564-bb72-2d9e5c472c3f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:06.900485 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c2369fac-db6c-4564-bb72-2d9e5c472c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:06.941955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:06.995816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 734/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:07.146068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadf76f-6c40-4f64-98a3-26b8059c49a2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:07.147635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cbadf76f-6c40-4f64-98a3-26b8059c49a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:07.289660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadf76f-6c40-4f64-98a3-26b8059c49a2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:07.342375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:07.400109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c7387-1e91-4e12-87cd-a306151f31b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:07.400648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7387-1e91-4e12-87cd-a306151f31b2 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:07.400930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7387-1e91-4e12-87cd-a306151f31b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:07.401201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7387-1e91-4e12-87cd-a306151f31b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:07.402853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1d1c7387-1e91-4e12-87cd-a306151f31b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:07.491385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c7387-1e91-4e12-87cd-a306151f31b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:07.492968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c7387-1e91-4e12-87cd-a306151f31b2 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:07.510866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 703/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:08.593924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729de8-db79-49a7-8730-555b1b98959c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:08.594500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729de8-db79-49a7-8730-555b1b98959c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:08.594500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64729de8-db79-49a7-8730-555b1b98959c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:08.595879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 735/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:08.601837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cdc96-085d-4dd6-bc4c-e8ce26f782d1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:08.602308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cdc96-085d-4dd6-bc4c-e8ce26f782d1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:08.602406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cdc96-085d-4dd6-bc4c-e8ce26f782d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:08.675213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b83cdc96-085d-4dd6-bc4c-e8ce26f782d1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:08.676403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b83cdc96-085d-4dd6-bc4c-e8ce26f782d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:08.678392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:08.771006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 704/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:08.919991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64729de8-db79-49a7-8730-555b1b98959c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:08.921558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-64729de8-db79-49a7-8730-555b1b98959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:09.066453 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64729de8-db79-49a7-8730-555b1b98959c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:09.092570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:09.175679 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2cd3a-88ce-4ce6-a233-03e990d7ddbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:09.176200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2cd3a-88ce-4ce6-a233-03e990d7ddbc service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:09.176477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2cd3a-88ce-4ce6-a233-03e990d7ddbc service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:09.176751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2cd3a-88ce-4ce6-a233-03e990d7ddbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:09.178374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-99b2cd3a-88ce-4ce6-a233-03e990d7ddbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:09.265556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2cd3a-88ce-4ce6-a233-03e990d7ddbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:09.267172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2cd3a-88ce-4ce6-a233-03e990d7ddbc service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:09.285095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 736/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:11.313825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f0413-0be6-4d44-89ef-109422e1b475 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:11.314971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f0413-0be6-4d44-89ef-109422e1b475 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:11.314971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f0413-0be6-4d44-89ef-109422e1b475 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:11.316268 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 705/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:11.321435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0be787-3418-4cf6-b3e2-3519f83e47f3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:11.321883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0be787-3418-4cf6-b3e2-3519f83e47f3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:11.321994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0be787-3418-4cf6-b3e2-3519f83e47f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:11.361850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:11.386693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ed0be787-3418-4cf6-b3e2-3519f83e47f3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:11.387890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ed0be787-3418-4cf6-b3e2-3519f83e47f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:11.482942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 737/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:11.765726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f0413-0be6-4d44-89ef-109422e1b475 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:11.767338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-944f0413-0be6-4d44-89ef-109422e1b475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:11.870046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f0413-0be6-4d44-89ef-109422e1b475 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:11.901796 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:11.943206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc58e7-96d1-47e2-84da-fae73681ac8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:11.943824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc58e7-96d1-47e2-84da-fae73681ac8c service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:11.944106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc58e7-96d1-47e2-84da-fae73681ac8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:11.944380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc58e7-96d1-47e2-84da-fae73681ac8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:11.945989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-45dc58e7-96d1-47e2-84da-fae73681ac8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:12.171883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc58e7-96d1-47e2-84da-fae73681ac8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:12.173255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc58e7-96d1-47e2-84da-fae73681ac8c service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:12.191153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 706/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:14.449890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01e0b-2ef6-48a2-8d4d-be285f9ad228 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:14.450463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01e0b-2ef6-48a2-8d4d-be285f9ad228 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:14.450463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01e0b-2ef6-48a2-8d4d-be285f9ad228 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:14.451824 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 738/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:14.457218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952fcf8-4af8-4eab-b015-4ab522617a4b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:14.457619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952fcf8-4af8-4eab-b015-4ab522617a4b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:14.457766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952fcf8-4af8-4eab-b015-4ab522617a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:14.520831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6952fcf8-4af8-4eab-b015-4ab522617a4b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:14.522017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6952fcf8-4af8-4eab-b015-4ab522617a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:14.535055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:14.615257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 707/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:14.896537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01e0b-2ef6-48a2-8d4d-be285f9ad228 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:14.898128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2df01e0b-2ef6-48a2-8d4d-be285f9ad228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:15.001048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01e0b-2ef6-48a2-8d4d-be285f9ad228 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:15.013630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:15.074202 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280ca25-080c-4b20-9670-c28a5d4ea4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:15.074802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280ca25-080c-4b20-9670-c28a5d4ea4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:15.075082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280ca25-080c-4b20-9670-c28a5d4ea4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:15.075352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280ca25-080c-4b20-9670-c28a5d4ea4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:15.076955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d280ca25-080c-4b20-9670-c28a5d4ea4a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:15.184084 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280ca25-080c-4b20-9670-c28a5d4ea4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:15.185439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280ca25-080c-4b20-9670-c28a5d4ea4a8 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:15.203264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 739/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:17.685321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d62d6-74fd-452d-b1cb-4137d90d8c08 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:17.685860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d62d6-74fd-452d-b1cb-4137d90d8c08 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:17.685860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d62d6-74fd-452d-b1cb-4137d90d8c08 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:17.687249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 708/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:17.693201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb29b3d-dd39-415e-b608-4f0398020bbe None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:17.693655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb29b3d-dd39-415e-b608-4f0398020bbe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:17.693774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb29b3d-dd39-415e-b608-4f0398020bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:17.740474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:17.758835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dcb29b3d-dd39-415e-b608-4f0398020bbe None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:17.760040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dcb29b3d-dd39-415e-b608-4f0398020bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:17.854822 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 740/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:18.137807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d62d6-74fd-452d-b1cb-4137d90d8c08 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.139400 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a17d62d6-74fd-452d-b1cb-4137d90d8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:18.240556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d62d6-74fd-452d-b1cb-4137d90d8c08 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:18.278674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:18.311270 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474da166-37e1-4049-a736-0d11ec311200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:18.311861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da166-37e1-4049-a736-0d11ec311200 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.312142 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da166-37e1-4049-a736-0d11ec311200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.312414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da166-37e1-4049-a736-0d11ec311200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.314066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-474da166-37e1-4049-a736-0d11ec311200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:18.419779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474da166-37e1-4049-a736-0d11ec311200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:18.421281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474da166-37e1-4049-a736-0d11ec311200 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:18.439646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 709/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:20.690573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948df37-b89e-4af5-b4a8-ebd5645e7a8c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:20.691113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948df37-b89e-4af5-b4a8-ebd5645e7a8c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:20.691113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948df37-b89e-4af5-b4a8-ebd5645e7a8c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:20.692477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 741/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:20.697741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52990af5-43d9-4acb-9f6e-66eb2228253f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:20.698171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52990af5-43d9-4acb-9f6e-66eb2228253f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:20.698323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52990af5-43d9-4acb-9f6e-66eb2228253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:20.762463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-52990af5-43d9-4acb-9f6e-66eb2228253f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:20.763669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-52990af5-43d9-4acb-9f6e-66eb2228253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:20.783900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:20.857161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 710/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:21.142745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948df37-b89e-4af5-b4a8-ebd5645e7a8c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:21.144303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4948df37-b89e-4af5-b4a8-ebd5645e7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:21.245539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948df37-b89e-4af5-b4a8-ebd5645e7a8c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:21.265354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:21.318477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88afa30-2841-4c4d-a609-9586a00fa36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:21.319066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88afa30-2841-4c4d-a609-9586a00fa36e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:21.319341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88afa30-2841-4c4d-a609-9586a00fa36e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:21.319607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88afa30-2841-4c4d-a609-9586a00fa36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:21.321204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d88afa30-2841-4c4d-a609-9586a00fa36e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:21.426765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88afa30-2841-4c4d-a609-9586a00fa36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:21.428188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88afa30-2841-4c4d-a609-9586a00fa36e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:21.445722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 742/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:23.626459 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7bb5-2e6a-4c37-a938-dd0fbe1a4fe7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:23.627000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7bb5-2e6a-4c37-a938-dd0fbe1a4fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:23.627000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b7bb5-2e6a-4c37-a938-dd0fbe1a4fe7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:23.628386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 711/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:23.633846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60af66-74cc-4d1d-ab96-88ca0febdb11 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:23.634319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60af66-74cc-4d1d-ab96-88ca0febdb11 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:23.634415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60af66-74cc-4d1d-ab96-88ca0febdb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:23.697542 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:23.700396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ba60af66-74cc-4d1d-ab96-88ca0febdb11 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:23.701620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ba60af66-74cc-4d1d-ab96-88ca0febdb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:23.796376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 743/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:24.079205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b7bb5-2e6a-4c37-a938-dd0fbe1a4fe7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:24.080766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-206b7bb5-2e6a-4c37-a938-dd0fbe1a4fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:24.182053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b7bb5-2e6a-4c37-a938-dd0fbe1a4fe7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:24.230884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:24.254436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fb0e8-bf95-435f-9d29-40677a3a1c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:24.255042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb0e8-bf95-435f-9d29-40677a3a1c1d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:24.255323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb0e8-bf95-435f-9d29-40677a3a1c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:24.255596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb0e8-bf95-435f-9d29-40677a3a1c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:24.257202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-539fb0e8-bf95-435f-9d29-40677a3a1c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:24.363441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fb0e8-bf95-435f-9d29-40677a3a1c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:24.364864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fb0e8-bf95-435f-9d29-40677a3a1c1d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:24.382204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 712/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:26.568763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577f0d-8349-479d-9f26-2962705fd27e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:26.569307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577f0d-8349-479d-9f26-2962705fd27e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:26.569307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577f0d-8349-479d-9f26-2962705fd27e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:26.570691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 744/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:26.575937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38975c-40e3-4eb7-8b05-3073975c89ab None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:26.576346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38975c-40e3-4eb7-8b05-3073975c89ab None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:26.576489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38975c-40e3-4eb7-8b05-3073975c89ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:26.643130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2d38975c-40e3-4eb7-8b05-3073975c89ab None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:26.644346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2d38975c-40e3-4eb7-8b05-3073975c89ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:26.674127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:26.740427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 713/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:27.034029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa577f0d-8349-479d-9f26-2962705fd27e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:27.035612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aa577f0d-8349-479d-9f26-2962705fd27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:27.137224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa577f0d-8349-479d-9f26-2962705fd27e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:27.166232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:27.211466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca92b7-ce15-4fb9-ab07-2d8f413a0c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:27.211993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca92b7-ce15-4fb9-ab07-2d8f413a0c15 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:27.212275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca92b7-ce15-4fb9-ab07-2d8f413a0c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:27.212548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca92b7-ce15-4fb9-ab07-2d8f413a0c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:27.214183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9dca92b7-ce15-4fb9-ab07-2d8f413a0c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:27.319886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca92b7-ce15-4fb9-ab07-2d8f413a0c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:27.321317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca92b7-ce15-4fb9-ab07-2d8f413a0c15 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:27.339600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 745/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:29.508929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb3b1f-d719-4586-8948-655eadb13eda None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:29.509473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb3b1f-d719-4586-8948-655eadb13eda None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:29.509473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb3b1f-d719-4586-8948-655eadb13eda None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:29.514120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 714/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:29.523620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545582e0-9c87-4ca2-954d-a1d8ea475fae None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:29.523620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545582e0-9c87-4ca2-954d-a1d8ea475fae None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:29.523620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545582e0-9c87-4ca2-954d-a1d8ea475fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:29.588876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-545582e0-9c87-4ca2-954d-a1d8ea475fae None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:29.590075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-545582e0-9c87-4ca2-954d-a1d8ea475fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:29.598382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:29.687714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 746/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:29.973819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb3b1f-d719-4586-8948-655eadb13eda None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:29.975401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7aeb3b1f-d719-4586-8948-655eadb13eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:30.079378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb3b1f-d719-4586-8948-655eadb13eda None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:30.133938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:30.151906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de39bc-4368-4af5-941f-771a3a751019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:30.152506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de39bc-4368-4af5-941f-771a3a751019 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:30.152787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de39bc-4368-4af5-941f-771a3a751019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:30.153059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de39bc-4368-4af5-941f-771a3a751019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:30.154700 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-26de39bc-4368-4af5-941f-771a3a751019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:30.261736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de39bc-4368-4af5-941f-771a3a751019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:30.263130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de39bc-4368-4af5-941f-771a3a751019 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:30.281098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 715/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:32.444349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437685b-2faa-4ebd-8cc1-2a79194aeb1f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.444922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437685b-2faa-4ebd-8cc1-2a79194aeb1f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.444922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437685b-2faa-4ebd-8cc1-2a79194aeb1f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.446342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 747/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:32.452001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ef71f-bbf6-4838-a48b-40c7a248f940 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:32.452420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ef71f-bbf6-4838-a48b-40c7a248f940 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:32.452526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ef71f-bbf6-4838-a48b-40c7a248f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:32.516438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e79ef71f-bbf6-4838-a48b-40c7a248f940 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:32.518389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e79ef71f-bbf6-4838-a48b-40c7a248f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:32.555219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:32.612772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 716/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:32.895522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437685b-2faa-4ebd-8cc1-2a79194aeb1f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:32.897116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9437685b-2faa-4ebd-8cc1-2a79194aeb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:33.000159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437685b-2faa-4ebd-8cc1-2a79194aeb1f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:33.038787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:33.075329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac033e4-c151-4008-b786-0d93fb5b2fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:33.075932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac033e4-c151-4008-b786-0d93fb5b2fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:33.076224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac033e4-c151-4008-b786-0d93fb5b2fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:33.076717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac033e4-c151-4008-b786-0d93fb5b2fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:33.078833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cac033e4-c151-4008-b786-0d93fb5b2fe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:33.183428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac033e4-c151-4008-b786-0d93fb5b2fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:33.184785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac033e4-c151-4008-b786-0d93fb5b2fe0 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:33.202769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 748/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:35.338592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f6d11-374c-4e31-b379-4ecd5528c560 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:35.339121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f6d11-374c-4e31-b379-4ecd5528c560 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:35.339121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f6d11-374c-4e31-b379-4ecd5528c560 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:35.340479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 717/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:35.345719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163013b-bdd9-4bff-90fd-894eeb40810d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:35.346136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163013b-bdd9-4bff-90fd-894eeb40810d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:35.346305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163013b-bdd9-4bff-90fd-894eeb40810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:35.411292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0163013b-bdd9-4bff-90fd-894eeb40810d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:35.412491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0163013b-bdd9-4bff-90fd-894eeb40810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:35.430286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:35.507603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 749/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:35.790186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f6d11-374c-4e31-b379-4ecd5528c560 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:35.791743 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cb4f6d11-374c-4e31-b379-4ecd5528c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:35.893871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f6d11-374c-4e31-b379-4ecd5528c560 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:35.959998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:35.966375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ba0f8-2284-49ca-acd9-ac3c77f7c19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:35.968160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ba0f8-2284-49ca-acd9-ac3c77f7c19a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:35.968160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ba0f8-2284-49ca-acd9-ac3c77f7c19a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:35.968160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ba0f8-2284-49ca-acd9-ac3c77f7c19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:35.969787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a44ba0f8-2284-49ca-acd9-ac3c77f7c19a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:36.077479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ba0f8-2284-49ca-acd9-ac3c77f7c19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:36.079445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ba0f8-2284-49ca-acd9-ac3c77f7c19a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:36.097929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 718/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:38.223802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee79a75-ab46-458c-9b77-5241cd79b7ec None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:38.224332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee79a75-ab46-458c-9b77-5241cd79b7ec None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:38.224332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee79a75-ab46-458c-9b77-5241cd79b7ec None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:38.225616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 750/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:38.230866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9f42-8347-4c9c-a4cb-d85cc8ed3fde None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:38.231293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9f42-8347-4c9c-a4cb-d85cc8ed3fde None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:38.231424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9f42-8347-4c9c-a4cb-d85cc8ed3fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:38.294903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9a8b9f42-8347-4c9c-a4cb-d85cc8ed3fde None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:38.296112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9a8b9f42-8347-4c9c-a4cb-d85cc8ed3fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:38.343095 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:38.390794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 719/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:38.672789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee79a75-ab46-458c-9b77-5241cd79b7ec None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:38.674367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1ee79a75-ab46-458c-9b77-5241cd79b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:38.774957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee79a75-ab46-458c-9b77-5241cd79b7ec None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:38.822303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:38.847684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdf195-f802-417a-825d-5e56201bbde5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:38.848271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdf195-f802-417a-825d-5e56201bbde5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:38.848547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdf195-f802-417a-825d-5e56201bbde5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:38.848814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdf195-f802-417a-825d-5e56201bbde5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:38.850423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98cdf195-f802-417a-825d-5e56201bbde5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:38.956666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdf195-f802-417a-825d-5e56201bbde5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:38.958125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdf195-f802-417a-825d-5e56201bbde5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:38.976803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 751/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:48.389273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=22 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:48.974434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=66 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:58.932755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1e711-3615-4190-afa9-d6db205f30dd None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:58.933354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1e711-3615-4190-afa9-d6db205f30dd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:58.933354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1e711-3615-4190-afa9-d6db205f30dd None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:58.934729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 720/1471] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:58.940905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5893e85-8d27-4878-9309-849ec7c88dc3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:58.941292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5893e85-8d27-4878-9309-849ec7c88dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:58.941483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5893e85-8d27-4878-9309-849ec7c88dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:59.006602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c5893e85-8d27-4878-9309-849ec7c88dc3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:59.007814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c5893e85-8d27-4878-9309-849ec7c88dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:59.101911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 752/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:59.398713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822af96-4a05-41c3-84a4-54a8909e8a80 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:59.399001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822af96-4a05-41c3-84a4-54a8909e8a80 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:59.399272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822af96-4a05-41c3-84a4-54a8909e8a80 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:59.400648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 721/1473] 10.222.0.33 () {54 vars in 962 bytes} [Tue Oct 4 08:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:55:59.405571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9d620-7f95-46df-ab33-48f59b7df730 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:59.405856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9d620-7f95-46df-ab33-48f59b7df730 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:59.406164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9d620-7f95-46df-ab33-48f59b7df730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:59.480756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-08a9d620-7f95-46df-ab33-48f59b7df730 None None] MFA Rules not processed for user `8a8339b6461e4e28bc397dcd3f85e1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:59.481965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-08a9d620-7f95-46df-ab33-48f59b7df730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:59.502748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:59.559125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 753/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Oct 4 08:55:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:59.566888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822af96-4a05-41c3-84a4-54a8909e8a80 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:59.568428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d822af96-4a05-41c3-84a4-54a8909e8a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:59.668336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822af96-4a05-41c3-84a4-54a8909e8a80 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:59.741734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa25087-010f-43e0-8d34-848522407283 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8339b6461e4e28bc397dcd3f85e1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:59.742369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25087-010f-43e0-8d34-848522407283 service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:59.742650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25087-010f-43e0-8d34-848522407283 service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:59.742924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25087-010f-43e0-8d34-848522407283 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:59.744566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-faa25087-010f-43e0-8d34-848522407283 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:59.801712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:59.857168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa25087-010f-43e0-8d34-848522407283 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:59.858663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa25087-010f-43e0-8d34-848522407283 service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:59.876662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 722/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:02.103753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3215969-cc97-472a-8db0-983e2776062a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:02.104386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3215969-cc97-472a-8db0-983e2776062a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:02.104386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3215969-cc97-472a-8db0-983e2776062a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:02.105661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 754/1476] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:56:02.110951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc3101-babb-4885-91f6-abe1aab7b086 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:02.111384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc3101-babb-4885-91f6-abe1aab7b086 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:02.111561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc3101-babb-4885-91f6-abe1aab7b086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:02.176987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c7fc3101-babb-4885-91f6-abe1aab7b086 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:02.178298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c7fc3101-babb-4885-91f6-abe1aab7b086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:02.273123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 723/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:02.551215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3215969-cc97-472a-8db0-983e2776062a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:02.552726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c3215969-cc97-472a-8db0-983e2776062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:02.675754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3215969-cc97-472a-8db0-983e2776062a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:02.724278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:02.768995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3666-e9be-49fe-8eb9-45764f93e4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:02.769601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3666-e9be-49fe-8eb9-45764f93e4bc admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:02.769879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3666-e9be-49fe-8eb9-45764f93e4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:02.770182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3666-e9be-49fe-8eb9-45764f93e4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:02.770827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b3666-e9be-49fe-8eb9-45764f93e4bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:02.772548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-8d3b3666-e9be-49fe-8eb9-45764f93e4bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:56:02.772548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 04 08:56:02.772548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: Oct 04 08:56:02.773685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b3666-e9be-49fe-8eb9-45764f93e4bc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:02.792336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 755/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Oct 4 08:56:02 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:56:04.941852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b40af-ba99-4b88-a6f9-9954f247df2c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:04.942293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b40af-ba99-4b88-a6f9-9954f247df2c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:04.942439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b40af-ba99-4b88-a6f9-9954f247df2c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:04.943808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 724/1479] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:56:04.949036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034730-cbfc-4fe0-bcf8-81dac5fd54e4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:04.949456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034730-cbfc-4fe0-bcf8-81dac5fd54e4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:04.949591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034730-cbfc-4fe0-bcf8-81dac5fd54e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:05.014601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b1034730-cbfc-4fe0-bcf8-81dac5fd54e4 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:05.015831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b1034730-cbfc-4fe0-bcf8-81dac5fd54e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:05.110719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 756/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:05.400510 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b40af-ba99-4b88-a6f9-9954f247df2c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:05.402175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d87b40af-ba99-4b88-a6f9-9954f247df2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:05.412518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:05.546358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b40af-ba99-4b88-a6f9-9954f247df2c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:05.625237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:05.657214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ede48-4f43-4066-95ac-20b66b7a9eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:05.657747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ede48-4f43-4066-95ac-20b66b7a9eb8 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:05.658032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ede48-4f43-4066-95ac-20b66b7a9eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:05.658328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ede48-4f43-4066-95ac-20b66b7a9eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:05.659913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ba7ede48-4f43-4066-95ac-20b66b7a9eb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:05.747194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ede48-4f43-4066-95ac-20b66b7a9eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:05.748810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ede48-4f43-4066-95ac-20b66b7a9eb8 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:05.766048 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 725/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:08.050667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ee197-b799-4d3c-a36b-138ee1af40bb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:08.051230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ee197-b799-4d3c-a36b-138ee1af40bb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:08.051230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ee197-b799-4d3c-a36b-138ee1af40bb None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:08.052561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 757/1482] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:56:08.057741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2a80f-297c-437a-959c-d53305a79fbf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:08.058141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2a80f-297c-437a-959c-d53305a79fbf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:08.058319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2a80f-297c-437a-959c-d53305a79fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:08.122242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e0b2a80f-297c-437a-959c-d53305a79fbf None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:08.123465 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e0b2a80f-297c-437a-959c-d53305a79fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:08.169204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:08.218790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 726/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:08.499597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ee197-b799-4d3c-a36b-138ee1af40bb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:08.501165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-251ee197-b799-4d3c-a36b-138ee1af40bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:08.524798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:08.603027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ee197-b799-4d3c-a36b-138ee1af40bb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:08.674251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff34449-6817-41ba-b4fc-1fb4ca1e171a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:08.674856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34449-6817-41ba-b4fc-1fb4ca1e171a service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:08.675136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34449-6817-41ba-b4fc-1fb4ca1e171a service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:08.675408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff34449-6817-41ba-b4fc-1fb4ca1e171a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:08.677004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ff34449-6817-41ba-b4fc-1fb4ca1e171a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:08.750163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:08.784780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34449-6817-41ba-b4fc-1fb4ca1e171a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:08.786231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff34449-6817-41ba-b4fc-1fb4ca1e171a service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:08.803522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 758/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:10.960012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0dee5-5d74-4434-b5df-9eec0245a781 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:10.960494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0dee5-5d74-4434-b5df-9eec0245a781 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:10.960599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0dee5-5d74-4434-b5df-9eec0245a781 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:10.961911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 727/1485] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:56:10.967785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099bd24-d0dd-4d6b-b5db-813a01870f2f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:10.968286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099bd24-d0dd-4d6b-b5db-813a01870f2f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:10.968385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099bd24-d0dd-4d6b-b5db-813a01870f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:11.033403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c099bd24-d0dd-4d6b-b5db-813a01870f2f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:11.034717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c099bd24-d0dd-4d6b-b5db-813a01870f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:11.130109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 759/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:11.416566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0dee5-5d74-4434-b5df-9eec0245a781 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:11.418247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e6e0dee5-5d74-4434-b5df-9eec0245a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:11.519853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0dee5-5d74-4434-b5df-9eec0245a781 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:11.590507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:11.591995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ade23-3014-4c61-838a-49d4dfbc1d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:11.592592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ade23-3014-4c61-838a-49d4dfbc1d4a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:11.592874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ade23-3014-4c61-838a-49d4dfbc1d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:11.593149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ade23-3014-4c61-838a-49d4dfbc1d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:11.594785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-915ade23-3014-4c61-838a-49d4dfbc1d4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:11.703005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ade23-3014-4c61-838a-49d4dfbc1d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:11.704436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ade23-3014-4c61-838a-49d4dfbc1d4a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:11.721748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 728/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:13.929079 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229766e-1807-44f9-b23f-75203a204990 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:13.929585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229766e-1807-44f9-b23f-75203a204990 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:13.929585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229766e-1807-44f9-b23f-75203a204990 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:13.930929 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 760/1488] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:56:13.936362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa4bd-f6ed-4453-ab85-bf9d35631fef None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:13.936804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa4bd-f6ed-4453-ab85-bf9d35631fef None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:13.936900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa4bd-f6ed-4453-ab85-bf9d35631fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:14.000947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-316aa4bd-f6ed-4453-ab85-bf9d35631fef None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:14.002165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-316aa4bd-f6ed-4453-ab85-bf9d35631fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:14.052951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:14.095839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 729/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:14.380992 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229766e-1807-44f9-b23f-75203a204990 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:14.382591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7229766e-1807-44f9-b23f-75203a204990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:14.419058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:14.485472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229766e-1807-44f9-b23f-75203a204990 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:14.558616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8471d-743b-40ab-b77e-4a3af54ea6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:14.559210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8471d-743b-40ab-b77e-4a3af54ea6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:14.559494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8471d-743b-40ab-b77e-4a3af54ea6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:14.559792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8471d-743b-40ab-b77e-4a3af54ea6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:14.561912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18e8471d-743b-40ab-b77e-4a3af54ea6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:14.640264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:14.667532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8471d-743b-40ab-b77e-4a3af54ea6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:14.669049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8471d-743b-40ab-b77e-4a3af54ea6d9 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:14.687219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 761/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:56:17.192367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9f674-55f2-4e78-9997-095ec96b7445 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:17.192898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9f674-55f2-4e78-9997-095ec96b7445 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:17.192898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9f674-55f2-4e78-9997-095ec96b7445 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:17.194295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 730/1491] 10.222.0.33 () {54 vars in 927 bytes} [Tue Oct 4 08:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:56:17.199864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcdd79-b932-4037-b5c5-f8eb5e1b8667 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:17.200268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcdd79-b932-4037-b5c5-f8eb5e1b8667 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:17.200427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcdd79-b932-4037-b5c5-f8eb5e1b8667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:17.265165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2cbcdd79-b932-4037-b5c5-f8eb5e1b8667 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:17.266400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2cbcdd79-b932-4037-b5c5-f8eb5e1b8667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:17.361065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 762/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Oct 4 08:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:17.647175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9f674-55f2-4e78-9997-095ec96b7445 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:17.648745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6da9f674-55f2-4e78-9997-095ec96b7445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:17.750670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9f674-55f2-4e78-9997-095ec96b7445 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:17.823220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698007d-b806-46b5-af7c-4c0dd1ba0765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:17.823827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698007d-b806-46b5-af7c-4c0dd1ba0765 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:17.824110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698007d-b806-46b5-af7c-4c0dd1ba0765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:17.824385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698007d-b806-46b5-af7c-4c0dd1ba0765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:17.826808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4698007d-b806-46b5-af7c-4c0dd1ba0765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:17.835075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:17.933202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698007d-b806-46b5-af7c-4c0dd1ba0765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:17.934620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698007d-b806-46b5-af7c-4c0dd1ba0765 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:17.953254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 731/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:27.359376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=82 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:27.950428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=50 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:38.440166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577995c-cfb9-492e-809e-49243e0ce81d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:38.440764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577995c-cfb9-492e-809e-49243e0ce81d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:38.440764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577995c-cfb9-492e-809e-49243e0ce81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:38.515675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4577995c-cfb9-492e-809e-49243e0ce81d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:38.516909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4577995c-cfb9-492e-809e-49243e0ce81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:38.610743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 763/1494] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 08:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:38.618792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311d4a2-0e6b-46d3-a539-86d96b575fe6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:38.619286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311d4a2-0e6b-46d3-a539-86d96b575fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:38.619391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311d4a2-0e6b-46d3-a539-86d96b575fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:38.694620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e311d4a2-0e6b-46d3-a539-86d96b575fe6 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:38.696004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e311d4a2-0e6b-46d3-a539-86d96b575fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:38.789885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 732/1495] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 08:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:38.795218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577995c-cfb9-492e-809e-49243e0ce81d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:38.796433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4577995c-cfb9-492e-809e-49243e0ce81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:38.807643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577995c-cfb9-492e-809e-49243e0ce81d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:38.867595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:38.899326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:38.899929 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:38.900204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:38.900470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:38.901110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:57:38.901412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:38.902939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:57:38.902939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 04 08:57:38.902939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: Oct 04 08:57:38.903823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:38.915124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 764/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 08:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:57:38.923756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311d4a2-0e6b-46d3-a539-86d96b575fe6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:38.932808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311d4a2-0e6b-46d3-a539-86d96b575fe6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:38.993812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:39.026259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:39.027386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:39.027669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:39.027941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:39.028578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:39.030311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:57:39.030311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 04 08:57:39.030311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: Oct 04 08:57:39.031498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:39.156145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 733/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 08:57:38 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:57:39.160310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:39.161833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:39.194236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab21d3-4bdd-4633-b7b9-a3cc9762d3c8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:39.284473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:39.285000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:39.285277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:39.285547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:39.286205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:39.287208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:57:39.287208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 04 08:57:39.287208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: Oct 04 08:57:39.288407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:39.407090 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 765/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 08:57:39 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:57:39.411328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:39.412914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:39.472788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c242a78-8359-4dd8-8a4d-48cdabe47a78 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:39.552628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:39.562917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:39.563512 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:39.563819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:39.564092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:39.564728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:39.565729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:57:39.565729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 04 08:57:39.565729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: Oct 04 08:57:39.566645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:39.581147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 734/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 08:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:57:39.585247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:39.586796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:39.598187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4f0fb-f54c-47bc-9b63-77a21c7c9d27 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:39.623679 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:39.690729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b94b8-133f-44ac-8fc7-8abbc1e0f9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:39.691329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b94b8-133f-44ac-8fc7-8abbc1e0f9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:39.691604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b94b8-133f-44ac-8fc7-8abbc1e0f9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:39.691869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b94b8-133f-44ac-8fc7-8abbc1e0f9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:39.692510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b94b8-133f-44ac-8fc7-8abbc1e0f9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:39.693514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-b51b94b8-133f-44ac-8fc7-8abbc1e0f9e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:57:39.693514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 04 08:57:39.693514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: Oct 04 08:57:39.694421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b94b8-133f-44ac-8fc7-8abbc1e0f9e0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:39.708502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 766/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 08:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:57:39.713085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:39.714437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:39.747320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df8399-01fb-4ae6-bda1-58f2490d9f0e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:39.840213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235880a-e9de-458e-adbe-598a8678471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:39.840776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235880a-e9de-458e-adbe-598a8678471a admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:39.841057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235880a-e9de-458e-adbe-598a8678471a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:39.841331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235880a-e9de-458e-adbe-598a8678471a admin admin] PATH_INFO: `/v3/projects/ca199033771847229f63da2fcb986b66/users/a05396135b464c068d768914134b0f54/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:39.863426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235880a-e9de-458e-adbe-598a8678471a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca199033771847229f63da2fcb986b66, user_id=a05396135b464c068d768914134b0f54, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:39.864434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-1235880a-e9de-458e-adbe-598a8678471a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:57:39.864434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 04 08:57:39.864434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: Oct 04 08:57:39.866438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235880a-e9de-458e-adbe-598a8678471a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:39.932012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 735/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 08:57:39 2022] PUT /identity/v3/projects/ca199033771847229f63da2fcb986b66/users/a05396135b464c068d768914134b0f54/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:57:39.944860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc71b3-1ad4-48a6-9087-7b78f11171df None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:39.945183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc71b3-1ad4-48a6-9087-7b78f11171df None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:39.945457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc71b3-1ad4-48a6-9087-7b78f11171df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:40.002465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-87dc71b3-1ad4-48a6-9087-7b78f11171df None None] MFA Rules not processed for user `a05396135b464c068d768914134b0f54`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:40.003684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-87dc71b3-1ad4-48a6-9087-7b78f11171df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:40.079466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 767/1502] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 08:57:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:40.092491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448121c-e767-466f-b440-4d15100dba93 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:40.092722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448121c-e767-466f-b440-4d15100dba93 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:40.092997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448121c-e767-466f-b440-4d15100dba93 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:40.094416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 736/1503] 10.222.0.33 () {54 vars in 963 bytes} [Tue Oct 4 08:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:57:40.099177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f44af5-dab5-4f1a-b241-546d1de7184c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:40.099470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f44af5-dab5-4f1a-b241-546d1de7184c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:40.099748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f44af5-dab5-4f1a-b241-546d1de7184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:40.131296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:40.175313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d5f44af5-dab5-4f1a-b241-546d1de7184c None None] MFA Rules not processed for user `d4f8f6b881a9476bb0951bc68d17ca70`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:40.176521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d5f44af5-dab5-4f1a-b241-546d1de7184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:40.250246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 768/1504] 10.222.0.33 () {58 vars in 1060 bytes} [Tue Oct 4 08:57:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:40.258075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448121c-e767-466f-b440-4d15100dba93 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:40.259604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8448121c-e767-466f-b440-4d15100dba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:40.308278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:40.361547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448121c-e767-466f-b440-4d15100dba93 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:40.432496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:40.433130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:40.433410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:40.433677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:40.435292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:40.533435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:40.534908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:40.538453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:40.553127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 737/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:40.603286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff98d-1574-4d89-852b-9904d1618307 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:40.603767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff98d-1574-4d89-852b-9904d1618307 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:40.603876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff98d-1574-4d89-852b-9904d1618307 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:40.605930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 769/1506] 10.222.0.33 () {52 vars in 830 bytes} [Tue Oct 4 08:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:57:40.609321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:40.610597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:40.707722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c9425-2ded-4330-b501-6ccc94dac807 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:40.798113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:40.798737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:40.799007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:40.799280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] PATH_INFO: `/v3/users/a05396135b464c068d768914134b0f54` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:40.811704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05396135b464c068d768914134b0f54)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:40.812722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:57:40.812722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 04 08:57:40.812722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: Oct 04 08:57:40.813950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:40.824055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:41.024956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05396135b464c068d768914134b0f54'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:41.025423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05396135b464c068d768914134b0f54'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:41.039598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05396135b464c068d768914134b0f54'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:41.040052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05396135b464c068d768914134b0f54'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:41.063200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05396135b464c068d768914134b0f54'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:41.135220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 738/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 08:57:40 2022] DELETE /identity/v3/users/a05396135b464c068d768914134b0f54 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:57:41.140450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df835f82-bd2d-4282-b57b-ffbe87f959c3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:41.140737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df835f82-bd2d-4282-b57b-ffbe87f959c3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:41.141011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df835f82-bd2d-4282-b57b-ffbe87f959c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:41.197300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-df835f82-bd2d-4282-b57b-ffbe87f959c3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:41.198552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df835f82-bd2d-4282-b57b-ffbe87f959c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:41.271402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:41.283406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 770/1508] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 08:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:41.292896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:41.294273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:41.393971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92fe98-8de8-4a1d-8646-88ef67127d38 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:41.446601 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:41.464629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bda431-1247-456e-9c60-e4f332adb1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:41.465272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda431-1247-456e-9c60-e4f332adb1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:41.465554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda431-1247-456e-9c60-e4f332adb1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:41.465823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bda431-1247-456e-9c60-e4f332adb1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:41.467451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-52bda431-1247-456e-9c60-e4f332adb1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:41.572604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bda431-1247-456e-9c60-e4f332adb1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:41.573960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bda431-1247-456e-9c60-e4f332adb1a9 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:41.591776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 739/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:42.025333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df835f82-bd2d-4282-b57b-ffbe87f959c3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:42.026622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df835f82-bd2d-4282-b57b-ffbe87f959c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:42.038734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df835f82-bd2d-4282-b57b-ffbe87f959c3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:42.139813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:42.140445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:42.140726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:42.141001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] PATH_INFO: `/v3/projects/ca199033771847229f63da2fcb986b66` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:42.151562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca199033771847229f63da2fcb986b66)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:42.153181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:57:42.153181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 04 08:57:42.153181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: Oct 04 08:57:42.154446 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:42.260995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca199033771847229f63da2fcb986b66', 'request_id': 'req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:42.274377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca199033771847229f63da2fcb986b66', 'request_id': 'req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:42.363552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca199033771847229f63da2fcb986b66', 'request_id': 'req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:42.387133 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] The token cache is being invalidate because project ca199033771847229f63da2fcb986b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:57:42.387423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:42.387858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e6f7c7f6-0fe9-4298-85fe-76bb78a162e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:42.389269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 771/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 08:57:42 2022] DELETE /identity/v3/projects/ca199033771847229f63da2fcb986b66 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:57:51.589872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=62 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:52.384990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:14.620556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874fefe-e084-4014-a3dd-57314a3ecbe8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:14.621163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874fefe-e084-4014-a3dd-57314a3ecbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:14.621163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874fefe-e084-4014-a3dd-57314a3ecbe8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:14.622483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 740/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:59:14.627289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a190324-2f22-4d2f-9739-ca2008c4ab09 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:14.627775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a190324-2f22-4d2f-9739-ca2008c4ab09 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:14.627884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a190324-2f22-4d2f-9739-ca2008c4ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:14.706914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9a190324-2f22-4d2f-9739-ca2008c4ab09 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:14.708116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a190324-2f22-4d2f-9739-ca2008c4ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:14.807407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 772/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:14.963494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874fefe-e084-4014-a3dd-57314a3ecbe8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:14.965710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1874fefe-e084-4014-a3dd-57314a3ecbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:15.085081 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874fefe-e084-4014-a3dd-57314a3ecbe8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:15.090636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb51210-b24f-4920-9921-02b4a427f510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:15.091243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb51210-b24f-4920-9921-02b4a427f510 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:15.091527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb51210-b24f-4920-9921-02b4a427f510 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:15.091802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb51210-b24f-4920-9921-02b4a427f510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:15.099691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb51210-b24f-4920-9921-02b4a427f510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:15.101754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb51210-b24f-4920-9921-02b4a427f510 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:15.110580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 741/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:16.179833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5e78-a799-4764-bd80-4b8755d56177 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:16.180339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5e78-a799-4764-bd80-4b8755d56177 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:16.180440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5e78-a799-4764-bd80-4b8755d56177 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:16.181790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 773/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:59:16.188398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048204-c2d7-45b1-abfd-bccd1f3e53b4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:16.188881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048204-c2d7-45b1-abfd-bccd1f3e53b4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:16.188989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048204-c2d7-45b1-abfd-bccd1f3e53b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:16.211125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b8048204-c2d7-45b1-abfd-bccd1f3e53b4 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:16.212883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b8048204-c2d7-45b1-abfd-bccd1f3e53b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:16.220892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 742/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:16.372193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e5e78-a799-4764-bd80-4b8755d56177 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:16.386772 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e5e78-a799-4764-bd80-4b8755d56177 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:16.392172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393420a4-abf2-47a0-9995-7955bd983391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:16.392766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393420a4-abf2-47a0-9995-7955bd983391 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:16.393051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393420a4-abf2-47a0-9995-7955bd983391 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:16.393325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393420a4-abf2-47a0-9995-7955bd983391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:16.401972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393420a4-abf2-47a0-9995-7955bd983391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:16.403610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393420a4-abf2-47a0-9995-7955bd983391 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:16.413121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 774/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:16.556805 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbb982-a0e1-4103-a400-5a72229da1e9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:16.557090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbb982-a0e1-4103-a400-5a72229da1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:16.557369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbb982-a0e1-4103-a400-5a72229da1e9 None None] PATH_INFO: `/v3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:16.558745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 743/1517] 10.222.0.48 () {54 vars in 925 bytes} [Tue Oct 4 08:59:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:59:16.568908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad0786-6dec-4d1c-a5cd-070e959eb5dc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:16.569203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad0786-6dec-4d1c-a5cd-070e959eb5dc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:16.569480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad0786-6dec-4d1c-a5cd-070e959eb5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:16.629630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2aad0786-6dec-4d1c-a5cd-070e959eb5dc None None] MFA Rules not processed for user `efba357340ac47dca0b1742d4e04fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:16.630778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2aad0786-6dec-4d1c-a5cd-070e959eb5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:16.647770 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:16.701324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 775/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Oct 4 08:59:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:20.411726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d792f-c307-4536-81f6-d42f30178842 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:20.412219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d792f-c307-4536-81f6-d42f30178842 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:20.412314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d792f-c307-4536-81f6-d42f30178842 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:20.413660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 744/1519] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 08:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:59:20.419321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f2335-cde3-4255-9131-406fb4665991 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:20.419821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f2335-cde3-4255-9131-406fb4665991 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:20.419998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f2335-cde3-4255-9131-406fb4665991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:20.439620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b65f2335-cde3-4255-9131-406fb4665991 None None] MFA Rules not processed for user `efba357340ac47dca0b1742d4e04fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:20.441089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b65f2335-cde3-4255-9131-406fb4665991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:20.449898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 776/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 08:59:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:20.457690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d792f-c307-4536-81f6-d42f30178842 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:20.475373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d792f-c307-4536-81f6-d42f30178842 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:20.477900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b42d3d-24f2-42e8-b544-bab2f7fac960 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:20.478540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b42d3d-24f2-42e8-b544-bab2f7fac960 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:20.478822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b42d3d-24f2-42e8-b544-bab2f7fac960 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:20.479095 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b42d3d-24f2-42e8-b544-bab2f7fac960 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:20.487707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b42d3d-24f2-42e8-b544-bab2f7fac960 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:20.489278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b42d3d-24f2-42e8-b544-bab2f7fac960 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:20.499113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 745/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:27.874030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65196f4-74ed-455d-901c-cd595269b3b7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:27.874567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65196f4-74ed-455d-901c-cd595269b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:27.874677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65196f4-74ed-455d-901c-cd595269b3b7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:27.875940 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 777/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:59:27.881870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed14b4-1509-4c43-8591-28d3dfec7aeb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:27.882344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed14b4-1509-4c43-8591-28d3dfec7aeb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:27.882444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed14b4-1509-4c43-8591-28d3dfec7aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:27.902183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-24ed14b4-1509-4c43-8591-28d3dfec7aeb None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:27.903376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-24ed14b4-1509-4c43-8591-28d3dfec7aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:27.911281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 746/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:28.063730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65196f4-74ed-455d-901c-cd595269b3b7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:28.078576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65196f4-74ed-455d-901c-cd595269b3b7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:28.084019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a82cc-89b0-4cf2-a503-fd41e1d1cd97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:28.084610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a82cc-89b0-4cf2-a503-fd41e1d1cd97 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:28.084887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a82cc-89b0-4cf2-a503-fd41e1d1cd97 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:28.085156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a82cc-89b0-4cf2-a503-fd41e1d1cd97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:28.093817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a82cc-89b0-4cf2-a503-fd41e1d1cd97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:28.095448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a82cc-89b0-4cf2-a503-fd41e1d1cd97 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:28.105587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 778/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:29.172102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db30c6-46dc-45f4-9b91-d1e2a3f244ab None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.172670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db30c6-46dc-45f4-9b91-d1e2a3f244ab None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.172670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db30c6-46dc-45f4-9b91-d1e2a3f244ab None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.174000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 747/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:59:29.180209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbc11d-8c75-4107-b0b2-a900b14d7318 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.180653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbc11d-8c75-4107-b0b2-a900b14d7318 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.180756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbc11d-8c75-4107-b0b2-a900b14d7318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.201482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-48cbc11d-8c75-4107-b0b2-a900b14d7318 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:29.202639 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-48cbc11d-8c75-4107-b0b2-a900b14d7318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:29.210455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 779/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:29.363994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db30c6-46dc-45f4-9b91-d1e2a3f244ab None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.378872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db30c6-46dc-45f4-9b91-d1e2a3f244ab None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.385119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72324c87-a97c-43aa-8efe-0562ed155937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.385721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72324c87-a97c-43aa-8efe-0562ed155937 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.386003 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72324c87-a97c-43aa-8efe-0562ed155937 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.386306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72324c87-a97c-43aa-8efe-0562ed155937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.394316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72324c87-a97c-43aa-8efe-0562ed155937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.395888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72324c87-a97c-43aa-8efe-0562ed155937 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.405080 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 748/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:33.408729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98ac7-184b-4e2c-bc6d-5ae261b4f0d1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:33.409323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98ac7-184b-4e2c-bc6d-5ae261b4f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:33.409323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b98ac7-184b-4e2c-bc6d-5ae261b4f0d1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:33.410721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 780/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:59:33.415812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b7c41-7191-4509-a27e-e5e25c3b5fc6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:33.416216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b7c41-7191-4509-a27e-e5e25c3b5fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:33.416362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b7c41-7191-4509-a27e-e5e25c3b5fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:33.435740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3e6b7c41-7191-4509-a27e-e5e25c3b5fc6 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:33.436926 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3e6b7c41-7191-4509-a27e-e5e25c3b5fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:33.444932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 749/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:33.730530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b98ac7-184b-4e2c-bc6d-5ae261b4f0d1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:33.732262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-42b98ac7-184b-4e2c-bc6d-5ae261b4f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:33.809082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b98ac7-184b-4e2c-bc6d-5ae261b4f0d1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:33.812666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d5741-169d-470e-ab09-5dbec5bc7907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:33.813262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d5741-169d-470e-ab09-5dbec5bc7907 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:33.813548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d5741-169d-470e-ab09-5dbec5bc7907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:33.813823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d5741-169d-470e-ab09-5dbec5bc7907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:33.823609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d5741-169d-470e-ab09-5dbec5bc7907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:33.825040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d5741-169d-470e-ab09-5dbec5bc7907 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:33.834319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 781/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:35.937775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb2370-aee9-4474-9eae-dfdca556814b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.938364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb2370-aee9-4474-9eae-dfdca556814b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.938364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb2370-aee9-4474-9eae-dfdca556814b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.939725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 750/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:59:35.945234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7505-468d-4c1a-9827-150f6a9f8f84 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.945663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7505-468d-4c1a-9827-150f6a9f8f84 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.945771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c7505-468d-4c1a-9827-150f6a9f8f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.965488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-373c7505-468d-4c1a-9827-150f6a9f8f84 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:35.966724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-373c7505-468d-4c1a-9827-150f6a9f8f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:35.974555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 782/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:36.263684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb2370-aee9-4474-9eae-dfdca556814b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:36.274877 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb2370-aee9-4474-9eae-dfdca556814b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:36.278379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fccbe-9613-44dc-82bf-8c1191e97d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:36.279002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fccbe-9613-44dc-82bf-8c1191e97d56 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:36.279292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fccbe-9613-44dc-82bf-8c1191e97d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:36.279559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fccbe-9613-44dc-82bf-8c1191e97d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:36.288233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fccbe-9613-44dc-82bf-8c1191e97d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:36.289678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fccbe-9613-44dc-82bf-8c1191e97d56 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:36.298996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 751/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:39.899362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2a7f9-166d-4bbd-bd2f-08adb97e7425 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:39.899924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2a7f9-166d-4bbd-bd2f-08adb97e7425 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:39.899924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2a7f9-166d-4bbd-bd2f-08adb97e7425 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:39.901337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 783/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:59:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:59:39.906814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996ad8-b18e-4f4a-9437-2147058b932b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:39.907243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996ad8-b18e-4f4a-9437-2147058b932b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:39.907368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67996ad8-b18e-4f4a-9437-2147058b932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:39.926463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-67996ad8-b18e-4f4a-9437-2147058b932b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:39.927707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-67996ad8-b18e-4f4a-9437-2147058b932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:39.935767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 752/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:40.243386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2a7f9-166d-4bbd-bd2f-08adb97e7425 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:40.245089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9fe2a7f9-166d-4bbd-bd2f-08adb97e7425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:40.312683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:40.329651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2a7f9-166d-4bbd-bd2f-08adb97e7425 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:40.333248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126af7e8-ee54-4a6b-89f4-463ce6679895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:40.336984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126af7e8-ee54-4a6b-89f4-463ce6679895 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:40.336984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126af7e8-ee54-4a6b-89f4-463ce6679895 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:40.336984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126af7e8-ee54-4a6b-89f4-463ce6679895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:40.343425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126af7e8-ee54-4a6b-89f4-463ce6679895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:40.344903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126af7e8-ee54-4a6b-89f4-463ce6679895 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:40.354294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 784/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:42.499619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aff79e-136c-41ee-bc45-a1f3e97c0061 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:42.500196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aff79e-136c-41ee-bc45-a1f3e97c0061 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:42.500196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aff79e-136c-41ee-bc45-a1f3e97c0061 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:42.501553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 753/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:59:42.506785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a439fa-6713-435b-8c64-94d17d7d2631 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:42.507207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a439fa-6713-435b-8c64-94d17d7d2631 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:42.507385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a439fa-6713-435b-8c64-94d17d7d2631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:42.526981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f6a439fa-6713-435b-8c64-94d17d7d2631 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:42.528182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f6a439fa-6713-435b-8c64-94d17d7d2631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:42.536143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 785/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:42.842156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aff79e-136c-41ee-bc45-a1f3e97c0061 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:42.843842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-63aff79e-136c-41ee-bc45-a1f3e97c0061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:42.851415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:42.857149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aff79e-136c-41ee-bc45-a1f3e97c0061 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:42.860720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b53b0-aa13-427f-90bf-6717bb4d3066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:42.861316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b53b0-aa13-427f-90bf-6717bb4d3066 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:42.861601 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b53b0-aa13-427f-90bf-6717bb4d3066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:42.861878 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b53b0-aa13-427f-90bf-6717bb4d3066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:42.870660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b53b0-aa13-427f-90bf-6717bb4d3066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:42.872104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b53b0-aa13-427f-90bf-6717bb4d3066 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:42.881635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 754/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:52.521652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=11 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:52.880488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:10.273815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d361a-8062-4872-aab5-66a5eb0496ac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.275914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d361a-8062-4872-aab5-66a5eb0496ac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.275914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d361a-8062-4872-aab5-66a5eb0496ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.299442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-282d361a-8062-4872-aab5-66a5eb0496ac None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.301191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-282d361a-8062-4872-aab5-66a5eb0496ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.313751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 786/1540] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.323434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9d4f-7028-4402-8379-484b5b84ca86 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.324023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9d4f-7028-4402-8379-484b5b84ca86 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.324023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a9d4f-7028-4402-8379-484b5b84ca86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.335005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bf09-217b-416e-a9e6-9744324cd42b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.335349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bf09-217b-416e-a9e6-9744324cd42b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.335659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bf09-217b-416e-a9e6-9744324cd42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.359960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-191a9d4f-7028-4402-8379-484b5b84ca86 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.361249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-191a9d4f-7028-4402-8379-484b5b84ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.367394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eb13bf09-217b-416e-a9e6-9744324cd42b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.368838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb13bf09-217b-416e-a9e6-9744324cd42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.380409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 755/1541] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.382532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 787/1542] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 04 09:01:10.387163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9d4f-7028-4402-8379-484b5b84ca86 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:10.391074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6f23-388e-4df4-8822-3cb628f12fb3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.391363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6f23-388e-4df4-8822-3cb628f12fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.391787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6f23-388e-4df4-8822-3cb628f12fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.403422 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a9d4f-7028-4402-8379-484b5b84ca86 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:10.420605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:10.421256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.421543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.421822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.422532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:10.422844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:10.423902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 09:01:10.423902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 04 09:01:10.423902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: Oct 04 09:01:10.424835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:10.427469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-211d6f23-388e-4df4-8822-3cb628f12fb3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.428971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-211d6f23-388e-4df4-8822-3cb628f12fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.444623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 756/1543] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:10.447868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 788/1544] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:01:10.452173 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:10.457569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6f23-388e-4df4-8822-3cb628f12fb3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:10.468722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b44829-beb8-409c-a28a-571311215851 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:10.472714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6f23-388e-4df4-8822-3cb628f12fb3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:10.479252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc36bb2-e8b9-453f-a436-931a7b744703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:10.479903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36bb2-e8b9-453f-a436-931a7b744703 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.480181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36bb2-e8b9-453f-a436-931a7b744703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.480460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc36bb2-e8b9-453f-a436-931a7b744703 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.481130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc36bb2-e8b9-453f-a436-931a7b744703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:10.481441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc36bb2-e8b9-453f-a436-931a7b744703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:10.483313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc36bb2-e8b9-453f-a436-931a7b744703 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:10.491098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2000ab-a16a-4d9b-b50f-2363e15b1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:10.491841 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2000ab-a16a-4d9b-b50f-2363e15b1295 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.492125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2000ab-a16a-4d9b-b50f-2363e15b1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.492403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2000ab-a16a-4d9b-b50f-2363e15b1295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.493084 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2000ab-a16a-4d9b-b50f-2363e15b1295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:10.494143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-1d2000ab-a16a-4d9b-b50f-2363e15b1295 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 09:01:10.494143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 04 09:01:10.494143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: Oct 04 09:01:10.498520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2000ab-a16a-4d9b-b50f-2363e15b1295 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:10.506219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 757/1545] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 09:01:10.511844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083520c0-f84b-467e-b389-0afc8b85df78 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.511844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083520c0-f84b-467e-b389-0afc8b85df78 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.511844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083520c0-f84b-467e-b389-0afc8b85df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.551482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-083520c0-f84b-467e-b389-0afc8b85df78 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.552702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-083520c0-f84b-467e-b389-0afc8b85df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.567646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 758/1546] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.573950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083520c0-f84b-467e-b389-0afc8b85df78 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:10.584132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083520c0-f84b-467e-b389-0afc8b85df78 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:10.591226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646af4d-8104-4c4e-af23-cd872275fb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:10.596936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646af4d-8104-4c4e-af23-cd872275fb58 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.596936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646af4d-8104-4c4e-af23-cd872275fb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.596936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646af4d-8104-4c4e-af23-cd872275fb58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.596936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646af4d-8104-4c4e-af23-cd872275fb58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:10.596936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646af4d-8104-4c4e-af23-cd872275fb58 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:10.643816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 789/1547] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:01:10.645932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b0aac-e1b6-4565-9bba-967243980b6d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.646271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b0aac-e1b6-4565-9bba-967243980b6d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.646556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b0aac-e1b6-4565-9bba-967243980b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.668975 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-898b0aac-e1b6-4565-9bba-967243980b6d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.670352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-898b0aac-e1b6-4565-9bba-967243980b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.684034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 759/1548] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:10.686477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9cfda-2cbd-4bba-8c0f-a10c321e2ae4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.687088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9cfda-2cbd-4bba-8c0f-a10c321e2ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.687590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9cfda-2cbd-4bba-8c0f-a10c321e2ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.712565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e1e9cfda-2cbd-4bba-8c0f-a10c321e2ae4 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.713891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e1e9cfda-2cbd-4bba-8c0f-a10c321e2ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.741620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 790/1549] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.742943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e973b5-a048-4668-a835-359175d46adc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.743289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e973b5-a048-4668-a835-359175d46adc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.743574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e973b5-a048-4668-a835-359175d46adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.770287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f1e973b5-a048-4668-a835-359175d46adc None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.771783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f1e973b5-a048-4668-a835-359175d46adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.774326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 760/1550] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.775220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9cfda-2cbd-4bba-8c0f-a10c321e2ae4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:10.780589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 791/1551] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.782665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52c07-d70d-4537-a9c9-4e683b941ef3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.783129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52c07-d70d-4537-a9c9-4e683b941ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.783413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52c07-d70d-4537-a9c9-4e683b941ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.785621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9cfda-2cbd-4bba-8c0f-a10c321e2ae4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:10.790889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07549d4-51de-40ad-98c6-e67ff0bc9a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:10.791502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07549d4-51de-40ad-98c6-e67ff0bc9a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.791790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07549d4-51de-40ad-98c6-e67ff0bc9a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.792073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07549d4-51de-40ad-98c6-e67ff0bc9a96 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.792716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07549d4-51de-40ad-98c6-e67ff0bc9a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:10.793766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-a07549d4-51de-40ad-98c6-e67ff0bc9a96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 09:01:10.793766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 04 09:01:10.793766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: Oct 04 09:01:10.795031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07549d4-51de-40ad-98c6-e67ff0bc9a96 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:10.802967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-faf52c07-d70d-4537-a9c9-4e683b941ef3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.804282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-faf52c07-d70d-4537-a9c9-4e683b941ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.813535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 792/1552] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.814566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52c07-d70d-4537-a9c9-4e683b941ef3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:10.826205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52c07-d70d-4537-a9c9-4e683b941ef3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:10.828960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f293f-3fe8-47f2-9842-1322a8a77912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:10.829539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f293f-3fe8-47f2-9842-1322a8a77912 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.829830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f293f-3fe8-47f2-9842-1322a8a77912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.830129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f293f-3fe8-47f2-9842-1322a8a77912 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.830756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f293f-3fe8-47f2-9842-1322a8a77912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:10.833531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f293f-3fe8-47f2-9842-1322a8a77912 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:10.864739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 761/1553] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:10.865982 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c619507-01b7-41f3-9657-a0e2b930bfd5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.866308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c619507-01b7-41f3-9657-a0e2b930bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.866605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c619507-01b7-41f3-9657-a0e2b930bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.886355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8c619507-01b7-41f3-9657-a0e2b930bfd5 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.887554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8c619507-01b7-41f3-9657-a0e2b930bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.896104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 762/1554] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.896865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c619507-01b7-41f3-9657-a0e2b930bfd5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:10.906170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c619507-01b7-41f3-9657-a0e2b930bfd5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:10.910903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b29d9-e2e3-415d-84d2-20973deb0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:10.911495 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b29d9-e2e3-415d-84d2-20973deb0122 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.911787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b29d9-e2e3-415d-84d2-20973deb0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.912094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b29d9-e2e3-415d-84d2-20973deb0122 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.912743 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b29d9-e2e3-415d-84d2-20973deb0122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:10.913050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b29d9-e2e3-415d-84d2-20973deb0122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:10.914728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b29d9-e2e3-415d-84d2-20973deb0122 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:10.923979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 793/1555] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:10.923979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b128-bd51-4596-b34d-aa1c9a6e24f9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.923979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b128-bd51-4596-b34d-aa1c9a6e24f9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.923979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388b128-bd51-4596-b34d-aa1c9a6e24f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.930821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 763/1556] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:10.932200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaf131-67e9-427e-9868-0ff38f795682 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.932552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaf131-67e9-427e-9868-0ff38f795682 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.932928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaf131-67e9-427e-9868-0ff38f795682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.952002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0388b128-bd51-4596-b34d-aa1c9a6e24f9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.953123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bbfaf131-67e9-427e-9868-0ff38f795682 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.953438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0388b128-bd51-4596-b34d-aa1c9a6e24f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.954327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bbfaf131-67e9-427e-9868-0ff38f795682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.961298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 794/1557] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.968879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a1236-4033-40f6-8d3f-97218599b610 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.968879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a1236-4033-40f6-8d3f-97218599b610 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.969066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 764/1558] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.969157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a1236-4033-40f6-8d3f-97218599b610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.969248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15803b16-456f-427f-b237-00a3fe201446 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.969248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15803b16-456f-427f-b237-00a3fe201446 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.969248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15803b16-456f-427f-b237-00a3fe201446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.983458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-15803b16-456f-427f-b237-00a3fe201446 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.983621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3f2a1236-4033-40f6-8d3f-97218599b610 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:10.984649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-15803b16-456f-427f-b237-00a3fe201446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.984785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3f2a1236-4033-40f6-8d3f-97218599b610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:10.993050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 765/1559] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.993374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 795/1560] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:10.994611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b755-7bdb-4e4e-b1b7-085df5b26343 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:10.994902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b755-7bdb-4e4e-b1b7-085df5b26343 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:10.995178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b755-7bdb-4e4e-b1b7-085df5b26343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:10.997506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15803b16-456f-427f-b237-00a3fe201446 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.008177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15803b16-456f-427f-b237-00a3fe201446 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.012904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e616d-9dd7-4f96-995d-7ad344225b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.013532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e616d-9dd7-4f96-995d-7ad344225b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.013877 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e616d-9dd7-4f96-995d-7ad344225b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.014110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e616d-9dd7-4f96-995d-7ad344225b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.014777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e616d-9dd7-4f96-995d-7ad344225b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.014885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a260b755-7bdb-4e4e-b1b7-085df5b26343 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:11.015975 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a260b755-7bdb-4e4e-b1b7-085df5b26343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:11.016378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e616d-9dd7-4f96-995d-7ad344225b51 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.024365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 796/1561] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:11.025155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b755-7bdb-4e4e-b1b7-085df5b26343 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.027143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 766/1562] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:11.027931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e616d-9dd7-4f96-995d-7ad344225b51 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.036815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b755-7bdb-4e4e-b1b7-085df5b26343 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.037945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e616d-9dd7-4f96-995d-7ad344225b51 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.041339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d71c4-8cec-42fc-90d5-792c91896fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.042004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d71c4-8cec-42fc-90d5-792c91896fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.042263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d71c4-8cec-42fc-90d5-792c91896fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.042538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acedb43-078f-43cd-873e-ac065a985971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.042656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d71c4-8cec-42fc-90d5-792c91896fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.043116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acedb43-078f-43cd-873e-ac065a985971 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.043219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d71c4-8cec-42fc-90d5-792c91896fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.043396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acedb43-078f-43cd-873e-ac065a985971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.043667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acedb43-078f-43cd-873e-ac065a985971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.044288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acedb43-078f-43cd-873e-ac065a985971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.044775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d71c4-8cec-42fc-90d5-792c91896fe8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.046376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acedb43-078f-43cd-873e-ac065a985971 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.055469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 797/1563] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:11.056256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d71c4-8cec-42fc-90d5-792c91896fe8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.067994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d71c4-8cec-42fc-90d5-792c91896fe8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.073691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f2548-1b5d-4988-add9-7fef97298eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.073830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f2548-1b5d-4988-add9-7fef97298eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.074010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f2548-1b5d-4988-add9-7fef97298eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.074316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f2548-1b5d-4988-add9-7fef97298eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.074967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f2548-1b5d-4988-add9-7fef97298eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:11.075275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f2548-1b5d-4988-add9-7fef97298eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.077080 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f2548-1b5d-4988-add9-7fef97298eb7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.089706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 798/1564] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:11.090954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dbce7-b71b-445a-9a59-147392f27a1f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.091249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dbce7-b71b-445a-9a59-147392f27a1f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.091528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dbce7-b71b-445a-9a59-147392f27a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.111396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-003dbce7-b71b-445a-9a59-147392f27a1f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:11.112591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-003dbce7-b71b-445a-9a59-147392f27a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:11.120392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 799/1565] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:11.121286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dbce7-b71b-445a-9a59-147392f27a1f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.130491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dbce7-b71b-445a-9a59-147392f27a1f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.134136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 767/1566] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:11.134136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acedb43-078f-43cd-873e-ac065a985971 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.151606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:11.156874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:11.187969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3178-6ac4-4a76-8d61-f3fed81344f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.188601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3178-6ac4-4a76-8d61-f3fed81344f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.188895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3178-6ac4-4a76-8d61-f3fed81344f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.189164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f3178-6ac4-4a76-8d61-f3fed81344f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.189801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f3178-6ac4-4a76-8d61-f3fed81344f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:11.190130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f3178-6ac4-4a76-8d61-f3fed81344f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.192288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f3178-6ac4-4a76-8d61-f3fed81344f4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.197663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acedb43-078f-43cd-873e-ac065a985971 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.203115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f840da-510a-4299-97ec-10072f56c985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.203747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f840da-510a-4299-97ec-10072f56c985 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.204019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 800/1567] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:11.204134 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f840da-510a-4299-97ec-10072f56c985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.204291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f840da-510a-4299-97ec-10072f56c985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.204878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3178-6ac4-4a76-8d61-f3fed81344f4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.204997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f840da-510a-4299-97ec-10072f56c985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:11.205226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f840da-510a-4299-97ec-10072f56c985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.206890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f840da-510a-4299-97ec-10072f56c985 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.218182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f3178-6ac4-4a76-8d61-f3fed81344f4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.218434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 768/1568] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:11.218983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f840da-510a-4299-97ec-10072f56c985 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.224182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c62d-c09c-4f53-85d3-b1ee091e54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.224788 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c62d-c09c-4f53-85d3-b1ee091e54f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.225068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c62d-c09c-4f53-85d3-b1ee091e54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.225822 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c62d-c09c-4f53-85d3-b1ee091e54f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.226908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c62d-c09c-4f53-85d3-b1ee091e54f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.229115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2c62d-c09c-4f53-85d3-b1ee091e54f3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.230338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f840da-510a-4299-97ec-10072f56c985 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.235605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dd729-6e04-444d-9490-21389f3d3d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.235605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dd729-6e04-444d-9490-21389f3d3d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.235871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dd729-6e04-444d-9490-21389f3d3d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.236146 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dd729-6e04-444d-9490-21389f3d3d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.236790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dd729-6e04-444d-9490-21389f3d3d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:11.237094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dd729-6e04-444d-9490-21389f3d3d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.239246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dd729-6e04-444d-9490-21389f3d3d00 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.241024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 801/1569] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:11.241909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c62d-c09c-4f53-85d3-b1ee091e54f3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.255912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 769/1570] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:11.256110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c62d-c09c-4f53-85d3-b1ee091e54f3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.256201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dd729-6e04-444d-9490-21389f3d3d00 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.259794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620e31-9344-4713-9657-63980b46b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.260388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620e31-9344-4713-9657-63980b46b163 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.260667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620e31-9344-4713-9657-63980b46b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.260943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620e31-9344-4713-9657-63980b46b163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.261584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620e31-9344-4713-9657-63980b46b163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.263261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620e31-9344-4713-9657-63980b46b163 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.265701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dd729-6e04-444d-9490-21389f3d3d00 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.270502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3d4e6-472a-4e61-9848-2a937c6b42a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.271094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3d4e6-472a-4e61-9848-2a937c6b42a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.271384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3d4e6-472a-4e61-9848-2a937c6b42a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.271661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3d4e6-472a-4e61-9848-2a937c6b42a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.272290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3d4e6-472a-4e61-9848-2a937c6b42a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.273738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 802/1571] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:11.274215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3d4e6-472a-4e61-9848-2a937c6b42a1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.274414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620e31-9344-4713-9657-63980b46b163 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.284261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620e31-9344-4713-9657-63980b46b163 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.289476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f1489-bc57-4b18-9099-68068aba79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.290067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1489-bc57-4b18-9099-68068aba79a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.290381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1489-bc57-4b18-9099-68068aba79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.290662 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f1489-bc57-4b18-9099-68068aba79a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.291426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f1489-bc57-4b18-9099-68068aba79a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:11.291832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f1489-bc57-4b18-9099-68068aba79a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.293486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f1489-bc57-4b18-9099-68068aba79a1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.306552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 803/1572] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:11.307643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f1489-bc57-4b18-9099-68068aba79a1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.317707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f1489-bc57-4b18-9099-68068aba79a1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.322351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003d8e4-70b2-4ef4-bfba-ed5a0d55fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.322926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003d8e4-70b2-4ef4-bfba-ed5a0d55fc52 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.323206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003d8e4-70b2-4ef4-bfba-ed5a0d55fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.323477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003d8e4-70b2-4ef4-bfba-ed5a0d55fc52 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.324127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003d8e4-70b2-4ef4-bfba-ed5a0d55fc52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.326074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003d8e4-70b2-4ef4-bfba-ed5a0d55fc52 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.362795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 770/1573] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:11.364275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3d4e6-472a-4e61-9848-2a937c6b42a1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.392074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 804/1574] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/users => generated 286 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:11.392074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003d8e4-70b2-4ef4-bfba-ed5a0d55fc52 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.402864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003d8e4-70b2-4ef4-bfba-ed5a0d55fc52 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.427847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3d4e6-472a-4e61-9848-2a937c6b42a1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.432549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e2ff-ed96-496f-a6da-1efb5462ca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.433153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e2ff-ed96-496f-a6da-1efb5462ca11 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.433430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e2ff-ed96-496f-a6da-1efb5462ca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.433701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348e2ff-ed96-496f-a6da-1efb5462ca11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.434395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348e2ff-ed96-496f-a6da-1efb5462ca11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.436532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348e2ff-ed96-496f-a6da-1efb5462ca11 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.460600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9e22e-2509-471e-ab4f-fc70d91a6757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.461208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9e22e-2509-471e-ab4f-fc70d91a6757 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.461487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9e22e-2509-471e-ab4f-fc70d91a6757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.461761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9e22e-2509-471e-ab4f-fc70d91a6757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.462416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9e22e-2509-471e-ab4f-fc70d91a6757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.464343 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9e22e-2509-471e-ab4f-fc70d91a6757 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.504382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 771/1575] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:11.505186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e2ff-ed96-496f-a6da-1efb5462ca11 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.564082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348e2ff-ed96-496f-a6da-1efb5462ca11 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.568651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d95e6-2900-4012-9d29-ee3179a25519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.569286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d95e6-2900-4012-9d29-ee3179a25519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.569567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d95e6-2900-4012-9d29-ee3179a25519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.569845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d95e6-2900-4012-9d29-ee3179a25519 admin admin] PATH_INFO: `/v3/projects/0c48864043694126aa6c52e86c887ad1/users/19654e46b7f34b2bbed41f691d3d9c5a/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.572020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:11.579426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 805/1576] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:11.580317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9e22e-2509-471e-ab4f-fc70d91a6757 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.585782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d95e6-2900-4012-9d29-ee3179a25519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c48864043694126aa6c52e86c887ad1, user_id=19654e46b7f34b2bbed41f691d3d9c5a, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.588504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d95e6-2900-4012-9d29-ee3179a25519 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.637348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:11.642303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9e22e-2509-471e-ab4f-fc70d91a6757 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.647431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7c29d-bcac-473e-a444-d2be9e252a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.648031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7c29d-bcac-473e-a444-d2be9e252a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.648313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7c29d-bcac-473e-a444-d2be9e252a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.648593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7c29d-bcac-473e-a444-d2be9e252a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.649217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7c29d-bcac-473e-a444-d2be9e252a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.651162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7c29d-bcac-473e-a444-d2be9e252a75 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.664772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 772/1577] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:11 2022] PUT /identity/v3/projects/0c48864043694126aa6c52e86c887ad1/users/19654e46b7f34b2bbed41f691d3d9c5a/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:11.665591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d95e6-2900-4012-9d29-ee3179a25519 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.726763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d95e6-2900-4012-9d29-ee3179a25519 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.731530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f537a-dfa0-4fd0-897e-224189442f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.732249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f537a-dfa0-4fd0-897e-224189442f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.732534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f537a-dfa0-4fd0-897e-224189442f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.732808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f537a-dfa0-4fd0-897e-224189442f09 admin admin] PATH_INFO: `/v3/projects/0184c2c3d1b547ec82cfc66588e40684/users/3dc1c615c8454fd28998a0df026de0f9/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.746026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 806/1578] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:11.746960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7c29d-bcac-473e-a444-d2be9e252a75 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.750817 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f537a-dfa0-4fd0-897e-224189442f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0184c2c3d1b547ec82cfc66588e40684, user_id=3dc1c615c8454fd28998a0df026de0f9, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.753526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f537a-dfa0-4fd0-897e-224189442f09 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.807132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7c29d-bcac-473e-a444-d2be9e252a75 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.811982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454b75-071a-47f1-a9a0-00a874d3019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.812577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454b75-071a-47f1-a9a0-00a874d3019b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.812858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454b75-071a-47f1-a9a0-00a874d3019b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.813128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06454b75-071a-47f1-a9a0-00a874d3019b admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.813752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06454b75-071a-47f1-a9a0-00a874d3019b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.815780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06454b75-071a-47f1-a9a0-00a874d3019b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.830093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 773/1579] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:11 2022] PUT /identity/v3/projects/0184c2c3d1b547ec82cfc66588e40684/users/3dc1c615c8454fd28998a0df026de0f9/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:11.835115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f537a-dfa0-4fd0-897e-224189442f09 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.895089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f537a-dfa0-4fd0-897e-224189442f09 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.899750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877f058-610c-45d1-b562-1a1edec3272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.900350 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877f058-610c-45d1-b562-1a1edec3272d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.900630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877f058-610c-45d1-b562-1a1edec3272d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.900904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877f058-610c-45d1-b562-1a1edec3272d admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.901543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877f058-610c-45d1-b562-1a1edec3272d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.903493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877f058-610c-45d1-b562-1a1edec3272d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.905690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 807/1580] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:11.906570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454b75-071a-47f1-a9a0-00a874d3019b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.968820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06454b75-071a-47f1-a9a0-00a874d3019b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:11.974129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e70b3-d8a4-4328-b3eb-89a5a5325714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:11.974736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e70b3-d8a4-4328-b3eb-89a5a5325714 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:11.975018 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e70b3-d8a4-4328-b3eb-89a5a5325714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:11.975310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e70b3-d8a4-4328-b3eb-89a5a5325714 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:11.975943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e70b3-d8a4-4328-b3eb-89a5a5325714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:11.977559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e70b3-d8a4-4328-b3eb-89a5a5325714 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:11.985099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 774/1581] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:11.985831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877f058-610c-45d1-b562-1a1edec3272d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.990139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 808/1582] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:11.990139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e70b3-d8a4-4328-b3eb-89a5a5325714 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:11.997368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877f058-610c-45d1-b562-1a1edec3272d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.001260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e70b3-d8a4-4328-b3eb-89a5a5325714 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.002123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124fbc5-ff1b-4ad2-be7f-2e67ef67de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.002757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124fbc5-ff1b-4ad2-be7f-2e67ef67de7d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.002993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124fbc5-ff1b-4ad2-be7f-2e67ef67de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.003249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124fbc5-ff1b-4ad2-be7f-2e67ef67de7d admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.004456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124fbc5-ff1b-4ad2-be7f-2e67ef67de7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.006477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124fbc5-ff1b-4ad2-be7f-2e67ef67de7d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.007279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f5a2-2758-4433-bbc1-ba2822770963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.007870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f5a2-2758-4433-bbc1-ba2822770963 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.008158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f5a2-2758-4433-bbc1-ba2822770963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.008460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f5a2-2758-4433-bbc1-ba2822770963 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.009060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4f5a2-2758-4433-bbc1-ba2822770963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.011011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4f5a2-2758-4433-bbc1-ba2822770963 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.088341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 775/1583] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:12.089561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f30cd2-e6e3-4fc1-b8dd-808d51719737 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.089852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f30cd2-e6e3-4fc1-b8dd-808d51719737 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.090165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f30cd2-e6e3-4fc1-b8dd-808d51719737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.106224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 809/1584] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:11 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:12.107412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f5a2-2758-4433-bbc1-ba2822770963 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.117702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-23f30cd2-e6e3-4fc1-b8dd-808d51719737 None None] MFA Rules not processed for user `19654e46b7f34b2bbed41f691d3d9c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:12.118686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f5a2-2758-4433-bbc1-ba2822770963 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.118943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-23f30cd2-e6e3-4fc1-b8dd-808d51719737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:12.123686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a8f2a-402f-4171-ba94-b7fdc74606e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.124282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a8f2a-402f-4171-ba94-b7fdc74606e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.124562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a8f2a-402f-4171-ba94-b7fdc74606e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.124833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a8f2a-402f-4171-ba94-b7fdc74606e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.125460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a8f2a-402f-4171-ba94-b7fdc74606e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.127711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a8f2a-402f-4171-ba94-b7fdc74606e6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.146365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:12.184696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 776/1585] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:12.186621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0df891-b5c4-4eac-8bc0-1d4581e60a73 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.186928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0df891-b5c4-4eac-8bc0-1d4581e60a73 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.187197 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0df891-b5c4-4eac-8bc0-1d4581e60a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.190754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 810/1586] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:12 2022] POST /identity/v3/users => generated 284 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:12.191603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a8f2a-402f-4171-ba94-b7fdc74606e6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.204083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a8f2a-402f-4171-ba94-b7fdc74606e6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.210529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5a294-307c-4bcd-8b49-d93f154e1397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.210529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5a294-307c-4bcd-8b49-d93f154e1397 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.210529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5a294-307c-4bcd-8b49-d93f154e1397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.213763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5a294-307c-4bcd-8b49-d93f154e1397 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.213763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5a294-307c-4bcd-8b49-d93f154e1397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.213763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5a294-307c-4bcd-8b49-d93f154e1397 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.218138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1f0df891-b5c4-4eac-8bc0-1d4581e60a73 None None] MFA Rules not processed for user `3dc1c615c8454fd28998a0df026de0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:12.219428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1f0df891-b5c4-4eac-8bc0-1d4581e60a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:12.281845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 811/1587] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:12 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:12.282605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5a294-307c-4bcd-8b49-d93f154e1397 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.286648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 777/1588] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:12.293803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0df891-b5c4-4eac-8bc0-1d4581e60a73 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.294915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5a294-307c-4bcd-8b49-d93f154e1397 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.299429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0df891-b5c4-4eac-8bc0-1d4581e60a73 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.299573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8a560-b364-4530-8701-346e35bde365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.300177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a560-b364-4530-8701-346e35bde365 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.300551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a560-b364-4530-8701-346e35bde365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.301344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a560-b364-4530-8701-346e35bde365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.301995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8a560-b364-4530-8701-346e35bde365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.303696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8a560-b364-4530-8701-346e35bde365 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.305273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4866a8-c10f-4f81-baa0-22260d6b6979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.305870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4866a8-c10f-4f81-baa0-22260d6b6979 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.306127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:12.306261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4866a8-c10f-4f81-baa0-22260d6b6979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.306448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4866a8-c10f-4f81-baa0-22260d6b6979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.307235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4866a8-c10f-4f81-baa0-22260d6b6979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.308884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4866a8-c10f-4f81-baa0-22260d6b6979 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.315527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 812/1589] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.318142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8a560-b364-4530-8701-346e35bde365 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.322129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 778/1590] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.322129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4866a8-c10f-4f81-baa0-22260d6b6979 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.326780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8a560-b364-4530-8701-346e35bde365 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.331050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4866a8-c10f-4f81-baa0-22260d6b6979 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.331303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f7fa-7209-47cb-8013-c15c1ec06978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.331997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f7fa-7209-47cb-8013-c15c1ec06978 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.332283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f7fa-7209-47cb-8013-c15c1ec06978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.332558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f7fa-7209-47cb-8013-c15c1ec06978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.333193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667f7fa-7209-47cb-8013-c15c1ec06978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.334810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667f7fa-7209-47cb-8013-c15c1ec06978 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.335918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45d5b9-51b8-45b8-a914-e65def6b58b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.336553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d5b9-51b8-45b8-a914-e65def6b58b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.336840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d5b9-51b8-45b8-a914-e65def6b58b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.337319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45d5b9-51b8-45b8-a914-e65def6b58b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.338216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d5b9-51b8-45b8-a914-e65def6b58b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.340714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45d5b9-51b8-45b8-a914-e65def6b58b2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.345332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 813/1591] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.346746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f7fa-7209-47cb-8013-c15c1ec06978 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.354235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 779/1592] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.354235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f824d5e-0aab-4af2-9da1-5da203770c76 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.354235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f824d5e-0aab-4af2-9da1-5da203770c76 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.354235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f824d5e-0aab-4af2-9da1-5da203770c76 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.356956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f7fa-7209-47cb-8013-c15c1ec06978 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.358147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 780/1593] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 09:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:01:12.359162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f824d5e-0aab-4af2-9da1-5da203770c76 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.361858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04211a78-bea4-4961-b68b-b031757fe1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.362494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04211a78-bea4-4961-b68b-b031757fe1df admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.362777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04211a78-bea4-4961-b68b-b031757fe1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.363625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04211a78-bea4-4961-b68b-b031757fe1df admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.364277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04211a78-bea4-4961-b68b-b031757fe1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.365889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04211a78-bea4-4961-b68b-b031757fe1df admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.372181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f824d5e-0aab-4af2-9da1-5da203770c76 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.376033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 814/1594] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.376806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04211a78-bea4-4961-b68b-b031757fe1df admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.379747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af04cb9-ca9c-4da9-bcdc-3eb618392072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.380364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af04cb9-ca9c-4da9-bcdc-3eb618392072 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.380641 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af04cb9-ca9c-4da9-bcdc-3eb618392072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.380909 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af04cb9-ca9c-4da9-bcdc-3eb618392072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.381670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af04cb9-ca9c-4da9-bcdc-3eb618392072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.383359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af04cb9-ca9c-4da9-bcdc-3eb618392072 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.388310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04211a78-bea4-4961-b68b-b031757fe1df admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.392863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8c7a0-fea1-4a0a-93b3-6e90b234af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.393479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c7a0-fea1-4a0a-93b3-6e90b234af20 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.394761 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 781/1595] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.394895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c7a0-fea1-4a0a-93b3-6e90b234af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.395123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c7a0-fea1-4a0a-93b3-6e90b234af20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.395487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af04cb9-ca9c-4da9-bcdc-3eb618392072 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.395758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8c7a0-fea1-4a0a-93b3-6e90b234af20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.397657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8c7a0-fea1-4a0a-93b3-6e90b234af20 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.405278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af04cb9-ca9c-4da9-bcdc-3eb618392072 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.409817 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c536b20-fe9e-4138-9b14-f75aef968911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.411176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c536b20-fe9e-4138-9b14-f75aef968911 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.411459 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c536b20-fe9e-4138-9b14-f75aef968911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.411732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c536b20-fe9e-4138-9b14-f75aef968911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.412367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c536b20-fe9e-4138-9b14-f75aef968911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.413937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c536b20-fe9e-4138-9b14-f75aef968911 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.423859 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 782/1596] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.424747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c536b20-fe9e-4138-9b14-f75aef968911 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.434258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c536b20-fe9e-4138-9b14-f75aef968911 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.439156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af5728-6b9a-4b95-bf11-3b9d10dcca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.439822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af5728-6b9a-4b95-bf11-3b9d10dcca3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.440102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af5728-6b9a-4b95-bf11-3b9d10dcca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.440377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af5728-6b9a-4b95-bf11-3b9d10dcca3c admin admin] PATH_INFO: `/v3/projects/95f7f86e0f85418585888bb3b8c403cd/users/79699b64c17945a681b3c5336fa0273b/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.455354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af5728-6b9a-4b95-bf11-3b9d10dcca3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f7f86e0f85418585888bb3b8c403cd, user_id=79699b64c17945a681b3c5336fa0273b, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.458627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af5728-6b9a-4b95-bf11-3b9d10dcca3c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.487583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 815/1597] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:12 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:12.488446 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8c7a0-fea1-4a0a-93b3-6e90b234af20 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.548141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8c7a0-fea1-4a0a-93b3-6e90b234af20 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.552889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1cc31-3ac3-4486-af5f-dc55ce788646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.553493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1cc31-3ac3-4486-af5f-dc55ce788646 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.553776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1cc31-3ac3-4486-af5f-dc55ce788646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.554054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1cc31-3ac3-4486-af5f-dc55ce788646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.554759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1cc31-3ac3-4486-af5f-dc55ce788646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.556368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1cc31-3ac3-4486-af5f-dc55ce788646 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.566329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 816/1598] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.578558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1cc31-3ac3-4486-af5f-dc55ce788646 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.578704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 783/1599] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:12 2022] PUT /identity/v3/projects/95f7f86e0f85418585888bb3b8c403cd/users/79699b64c17945a681b3c5336fa0273b/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:12.578704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496663c7-2093-48ee-9745-44b40ed2b2bf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.578704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496663c7-2093-48ee-9745-44b40ed2b2bf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.578704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496663c7-2093-48ee-9745-44b40ed2b2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.579257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1cc31-3ac3-4486-af5f-dc55ce788646 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.608355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-496663c7-2093-48ee-9745-44b40ed2b2bf None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:12.609711 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-496663c7-2093-48ee-9745-44b40ed2b2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:12.637222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2a90-53d7-40c2-b92f-1e279cb80d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.637854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2a90-53d7-40c2-b92f-1e279cb80d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.638166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2a90-53d7-40c2-b92f-1e279cb80d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.638473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa2a90-53d7-40c2-b92f-1e279cb80d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.639115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2a90-53d7-40c2-b92f-1e279cb80d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.641474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa2a90-53d7-40c2-b92f-1e279cb80d46 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.652214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 817/1600] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.653703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2a90-53d7-40c2-b92f-1e279cb80d46 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.663742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa2a90-53d7-40c2-b92f-1e279cb80d46 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.668314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ca318-ebc8-4505-9514-b22b448d78ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.668977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ca318-ebc8-4505-9514-b22b448d78ce admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.669261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ca318-ebc8-4505-9514-b22b448d78ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.669537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ca318-ebc8-4505-9514-b22b448d78ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.670333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ca318-ebc8-4505-9514-b22b448d78ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.671915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ca318-ebc8-4505-9514-b22b448d78ce admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.674596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 784/1601] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 09:01:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:12.675671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496663c7-2093-48ee-9745-44b40ed2b2bf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.685457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 818/1602] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.685457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ca318-ebc8-4505-9514-b22b448d78ce admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.686671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496663c7-2093-48ee-9745-44b40ed2b2bf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.692146 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:12.692844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ca318-ebc8-4505-9514-b22b448d78ce admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.692964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff106b5-37f9-4f0e-a4da-d3f09a05ce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.693528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff106b5-37f9-4f0e-a4da-d3f09a05ce71 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.693806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff106b5-37f9-4f0e-a4da-d3f09a05ce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.694075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff106b5-37f9-4f0e-a4da-d3f09a05ce71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.694745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff106b5-37f9-4f0e-a4da-d3f09a05ce71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.696360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff106b5-37f9-4f0e-a4da-d3f09a05ce71 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.697426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4fd16-2b3a-4947-9a35-18b8faa94d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.698032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4fd16-2b3a-4947-9a35-18b8faa94d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.698358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4fd16-2b3a-4947-9a35-18b8faa94d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.698636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4fd16-2b3a-4947-9a35-18b8faa94d86 admin admin] PATH_INFO: `/v3/projects/eadb7754925144e3a850d25bd3271bf9/users/d8e640ff14a24cb78969f3601ec8f3d0/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.706578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 785/1603] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:12.707679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff106b5-37f9-4f0e-a4da-d3f09a05ce71 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.714762 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4fd16-2b3a-4947-9a35-18b8faa94d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadb7754925144e3a850d25bd3271bf9, user_id=d8e640ff14a24cb78969f3601ec8f3d0, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.720937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-a3c4fd16-2b3a-4947-9a35-18b8faa94d86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 09:01:12.720937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 04 09:01:12.720937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: Oct 04 09:01:12.720937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4fd16-2b3a-4947-9a35-18b8faa94d86 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.721314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff106b5-37f9-4f0e-a4da-d3f09a05ce71 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.724051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a604d47-0141-4ed3-b8b8-dec27c613fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.724632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604d47-0141-4ed3-b8b8-dec27c613fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.724910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604d47-0141-4ed3-b8b8-dec27c613fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.725180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604d47-0141-4ed3-b8b8-dec27c613fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.725845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a604d47-0141-4ed3-b8b8-dec27c613fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.727762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a604d47-0141-4ed3-b8b8-dec27c613fb6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.790238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 819/1604] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:12 2022] PUT /identity/v3/projects/eadb7754925144e3a850d25bd3271bf9/users/d8e640ff14a24cb78969f3601ec8f3d0/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:12.791038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4fd16-2b3a-4947-9a35-18b8faa94d86 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.803781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:12.821739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 786/1605] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:12 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:12.821739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ec2f-dea1-4c81-a71f-824e3e7d4ed8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.821739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ec2f-dea1-4c81-a71f-824e3e7d4ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.821739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ec2f-dea1-4c81-a71f-824e3e7d4ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.848765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dc85ec2f-dea1-4c81-a71f-824e3e7d4ed8 None None] MFA Rules not processed for user `79699b64c17945a681b3c5336fa0273b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:12.849995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dc85ec2f-dea1-4c81-a71f-824e3e7d4ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:12.853927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4fd16-2b3a-4947-9a35-18b8faa94d86 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.858724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7eeb-022c-4dec-83e0-23340d8b44d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.859321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7eeb-022c-4dec-83e0-23340d8b44d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.859598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7eeb-022c-4dec-83e0-23340d8b44d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.859870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7eeb-022c-4dec-83e0-23340d8b44d8 admin admin] PATH_INFO: `/v3/projects/2b93ea96d97c442db8a0559547db82aa/users/7d1240c674d74311b58fcafe2886ef2c/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.874351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de7eeb-022c-4dec-83e0-23340d8b44d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b93ea96d97c442db8a0559547db82aa, user_id=7d1240c674d74311b58fcafe2886ef2c, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.877481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de7eeb-022c-4dec-83e0-23340d8b44d8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.913507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 787/1606] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:12.914501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85ec2f-dea1-4c81-a71f-824e3e7d4ed8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:12.925068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85ec2f-dea1-4c81-a71f-824e3e7d4ed8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:12.931247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c11e1-feb1-4aca-b963-683f57e5e0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:12.932203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c11e1-feb1-4aca-b963-683f57e5e0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:12.932672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c11e1-feb1-4aca-b963-683f57e5e0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:12.933112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c11e1-feb1-4aca-b963-683f57e5e0cc admin admin] PATH_INFO: `/v3/projects/8bb21417664e4e0e8755d4af8a8bd84e/users/c4a7739dd7df42839fe5703515883e95/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:12.949692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c11e1-feb1-4aca-b963-683f57e5e0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb21417664e4e0e8755d4af8a8bd84e, user_id=c4a7739dd7df42839fe5703515883e95, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:12.952550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c11e1-feb1-4aca-b963-683f57e5e0cc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:12.966495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 820/1607] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:12 2022] PUT /identity/v3/projects/2b93ea96d97c442db8a0559547db82aa/users/7d1240c674d74311b58fcafe2886ef2c/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:12.967366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7eeb-022c-4dec-83e0-23340d8b44d8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.035747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 788/1608] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:12 2022] PUT /identity/v3/projects/8bb21417664e4e0e8755d4af8a8bd84e/users/c4a7739dd7df42839fe5703515883e95/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:13.036611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c11e1-feb1-4aca-b963-683f57e5e0cc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.038318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7eeb-022c-4dec-83e0-23340d8b44d8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.101488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c11e1-feb1-4aca-b963-683f57e5e0cc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.101715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c6fe7-b039-4d76-bc12-0b1d3fadb360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.102128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c6fe7-b039-4d76-bc12-0b1d3fadb360 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.102419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c6fe7-b039-4d76-bc12-0b1d3fadb360 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.102746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c6fe7-b039-4d76-bc12-0b1d3fadb360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.106125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f432eb-d112-4434-9d7a-1ce1f9ff58e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.106795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f432eb-d112-4434-9d7a-1ce1f9ff58e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.107076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f432eb-d112-4434-9d7a-1ce1f9ff58e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.107351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f432eb-d112-4434-9d7a-1ce1f9ff58e1 admin admin] PATH_INFO: `/v3/projects/ff25aa70ea07417db5df44d7c7ba49fb/users/9107a7f3acbc49a2bbcbfcfa7ef8ea16/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.115789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:13.122993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f432eb-d112-4434-9d7a-1ce1f9ff58e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff25aa70ea07417db5df44d7c7ba49fb, user_id=9107a7f3acbc49a2bbcbfcfa7ef8ea16, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:13.125793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f432eb-d112-4434-9d7a-1ce1f9ff58e1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:13.131922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:13.158377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c6fe7-b039-4d76-bc12-0b1d3fadb360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:13.160618 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c6fe7-b039-4d76-bc12-0b1d3fadb360 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:13.169715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 821/1609] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:13.170268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c6fe7-b039-4d76-bc12-0b1d3fadb360 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.180366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c6fe7-b039-4d76-bc12-0b1d3fadb360 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.185674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 789/1610] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:13 2022] PUT /identity/v3/projects/ff25aa70ea07417db5df44d7c7ba49fb/users/9107a7f3acbc49a2bbcbfcfa7ef8ea16/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:13.186748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cf9e4-de6b-4af8-824b-0f904c042eff None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.187038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cf9e4-de6b-4af8-824b-0f904c042eff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.187334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cf9e4-de6b-4af8-824b-0f904c042eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.209889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-080cf9e4-de6b-4af8-824b-0f904c042eff None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:13.211127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-080cf9e4-de6b-4af8-824b-0f904c042eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:13.251320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaad185-3d8c-40a1-89d8-ae6416de0d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.251976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad185-3d8c-40a1-89d8-ae6416de0d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.252262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad185-3d8c-40a1-89d8-ae6416de0d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.252534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad185-3d8c-40a1-89d8-ae6416de0d9e admin admin] PATH_INFO: `/v3/projects/9fdc2cf03b0348adb7805d782f6b0f83/users/25274e19c10c4e8fb35b37f06e6bfdf8/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.266825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaad185-3d8c-40a1-89d8-ae6416de0d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdc2cf03b0348adb7805d782f6b0f83, user_id=25274e19c10c4e8fb35b37f06e6bfdf8, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:13.270063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaad185-3d8c-40a1-89d8-ae6416de0d9e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:13.275989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 790/1611] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:13.276979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cf9e4-de6b-4af8-824b-0f904c042eff None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.288931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cf9e4-de6b-4af8-824b-0f904c042eff None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.293724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6ef59-9249-4d33-a070-99f2e7772e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.294557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ef59-9249-4d33-a070-99f2e7772e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.294835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ef59-9249-4d33-a070-99f2e7772e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.295103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6ef59-9249-4d33-a070-99f2e7772e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.295747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6ef59-9249-4d33-a070-99f2e7772e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:13.297337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6ef59-9249-4d33-a070-99f2e7772e10 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:13.307408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 791/1612] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:13.308679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd83c3-82b3-4272-8dcf-c9ce3b63d540 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.311799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd83c3-82b3-4272-8dcf-c9ce3b63d540 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.311799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd83c3-82b3-4272-8dcf-c9ce3b63d540 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.311799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 792/1613] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 09:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:01:13.314994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456ee37-24d8-4ee2-917d-e043642302fc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.315436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456ee37-24d8-4ee2-917d-e043642302fc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.315718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456ee37-24d8-4ee2-917d-e043642302fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.327830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 822/1614] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:13 2022] PUT /identity/v3/projects/9fdc2cf03b0348adb7805d782f6b0f83/users/25274e19c10c4e8fb35b37f06e6bfdf8/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:13.329780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a60368-7014-49f3-a081-cd209f9c98c8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.330266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a60368-7014-49f3-a081-cd209f9c98c8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.337564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a60368-7014-49f3-a081-cd209f9c98c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.337697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3456ee37-24d8-4ee2-917d-e043642302fc None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:13.338697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3456ee37-24d8-4ee2-917d-e043642302fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:13.362557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-91a60368-7014-49f3-a081-cd209f9c98c8 None None] MFA Rules not processed for user `c4a7739dd7df42839fe5703515883e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:13.364378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-91a60368-7014-49f3-a081-cd209f9c98c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:13.409028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 793/1615] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:13.410269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a43909-9cda-4e43-94ef-483c0692369b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.410643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a43909-9cda-4e43-94ef-483c0692369b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.410971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a43909-9cda-4e43-94ef-483c0692369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.430951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 823/1616] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:13.431893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a60368-7014-49f3-a081-cd209f9c98c8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.433255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-91a60368-7014-49f3-a081-cd209f9c98c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:13.444192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e6a43909-9cda-4e43-94ef-483c0692369b None None] MFA Rules not processed for user `9107a7f3acbc49a2bbcbfcfa7ef8ea16`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:13.445388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e6a43909-9cda-4e43-94ef-483c0692369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:13.479216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:13.491692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a60368-7014-49f3-a081-cd209f9c98c8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.495326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c7460-4055-4a55-8a56-03fa59c5bce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.495937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c7460-4055-4a55-8a56-03fa59c5bce2 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.496219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c7460-4055-4a55-8a56-03fa59c5bce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.496494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c7460-4055-4a55-8a56-03fa59c5bce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.506197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c7460-4055-4a55-8a56-03fa59c5bce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:13.507642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c7460-4055-4a55-8a56-03fa59c5bce2 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:13.508818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 794/1617] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:13.509731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a43909-9cda-4e43-94ef-483c0692369b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.519926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 824/1618] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:13.520069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a43909-9cda-4e43-94ef-483c0692369b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.521190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399f62-d22a-41fe-9da6-c3ecc3b1ed38 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.523956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399f62-d22a-41fe-9da6-c3ecc3b1ed38 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.523956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23399f62-d22a-41fe-9da6-c3ecc3b1ed38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.525373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf48a77-8268-4a58-a4cf-7083bb146184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.526150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48a77-8268-4a58-a4cf-7083bb146184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.526432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48a77-8268-4a58-a4cf-7083bb146184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.526801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48a77-8268-4a58-a4cf-7083bb146184 admin admin] PATH_INFO: `/v3/projects/e7adc512eaf644b98317a0e5acdfeb73/users/121237d295484812b329bbda17a3959e/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.529593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:13.543404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-23399f62-d22a-41fe-9da6-c3ecc3b1ed38 None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:13.544458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf48a77-8268-4a58-a4cf-7083bb146184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7adc512eaf644b98317a0e5acdfeb73, user_id=121237d295484812b329bbda17a3959e, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:13.545251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-23399f62-d22a-41fe-9da6-c3ecc3b1ed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:13.547184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf48a77-8268-4a58-a4cf-7083bb146184 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:13.611703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 825/1619] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 09:01:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:13.613572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f4561-0586-4103-94f6-e06bc9500165 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.613866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f4561-0586-4103-94f6-e06bc9500165 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.614173 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f4561-0586-4103-94f6-e06bc9500165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.633341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2b3f4561-0586-4103-94f6-e06bc9500165 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:13.634846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b3f4561-0586-4103-94f6-e06bc9500165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:13.636264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 795/1620] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:13 2022] PUT /identity/v3/projects/e7adc512eaf644b98317a0e5acdfeb73/users/121237d295484812b329bbda17a3959e/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:13.637265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13713ee9-f0a6-4379-bd8c-c7224ea4930d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.637583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13713ee9-f0a6-4379-bd8c-c7224ea4930d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.637830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13713ee9-f0a6-4379-bd8c-c7224ea4930d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.642232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 796/1621] 10.222.0.33 () {54 vars in 912 bytes} [Tue Oct 4 09:01:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:01:13.643049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13713ee9-f0a6-4379-bd8c-c7224ea4930d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.701650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 826/1622] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:13.701650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f4561-0586-4103-94f6-e06bc9500165 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.709678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13713ee9-f0a6-4379-bd8c-c7224ea4930d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.713655 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8292c-d1cb-4adb-b75f-ca687ecf1370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.714437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8292c-d1cb-4adb-b75f-ca687ecf1370 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.714920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8292c-d1cb-4adb-b75f-ca687ecf1370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.715290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8292c-d1cb-4adb-b75f-ca687ecf1370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.715391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f4561-0586-4103-94f6-e06bc9500165 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.720551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463a32b-cf0f-45ac-bdb6-d4599d15057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.721254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463a32b-cf0f-45ac-bdb6-d4599d15057f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.721487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463a32b-cf0f-45ac-bdb6-d4599d15057f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.721990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463a32b-cf0f-45ac-bdb6-d4599d15057f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.724397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463a32b-cf0f-45ac-bdb6-d4599d15057f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:13.726023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8292c-d1cb-4adb-b75f-ca687ecf1370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:13.728798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463a32b-cf0f-45ac-bdb6-d4599d15057f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:13.729013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8292c-d1cb-4adb-b75f-ca687ecf1370 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:13.737461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 797/1623] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:13.738861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8292c-d1cb-4adb-b75f-ca687ecf1370 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.791981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8292c-d1cb-4adb-b75f-ca687ecf1370 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.795691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2acde-c087-4f07-b4d1-47100c15ebdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.796293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2acde-c087-4f07-b4d1-47100c15ebdd service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.796578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2acde-c087-4f07-b4d1-47100c15ebdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.796855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2acde-c087-4f07-b4d1-47100c15ebdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:13.837227 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 827/1624] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:13 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:13.845106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463a32b-cf0f-45ac-bdb6-d4599d15057f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.884428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2acde-c087-4f07-b4d1-47100c15ebdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:13.886711 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2acde-c087-4f07-b4d1-47100c15ebdd service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:13.900460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 798/1625] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:13.901534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2acde-c087-4f07-b4d1-47100c15ebdd service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:13.917635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2acde-c087-4f07-b4d1-47100c15ebdd service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.955755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:13.973297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:13.975401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463a32b-cf0f-45ac-bdb6-d4599d15057f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:13.982041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93f9c6-faf2-44f1-aad4-929fa0ba2cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:13.982934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93f9c6-faf2-44f1-aad4-929fa0ba2cd8 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:13.983200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93f9c6-faf2-44f1-aad4-929fa0ba2cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:13.983454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93f9c6-faf2-44f1-aad4-929fa0ba2cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.000092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02033372-3fd2-4535-a185-368523b682e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:14.000092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033372-3fd2-4535-a185-368523b682e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.000092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033372-3fd2-4535-a185-368523b682e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.000092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02033372-3fd2-4535-a185-368523b682e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.000444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02033372-3fd2-4535-a185-368523b682e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.000444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02033372-3fd2-4535-a185-368523b682e3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.009918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 799/1626] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:14.011377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe312d5-d8af-42ca-acea-ab5aa564bf41 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.011768 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe312d5-d8af-42ca-acea-ab5aa564bf41 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.012139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe312d5-d8af-42ca-acea-ab5aa564bf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.041708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bfe312d5-d8af-42ca-acea-ab5aa564bf41 None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:14.042998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bfe312d5-d8af-42ca-acea-ab5aa564bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:14.065690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 800/1627] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:01:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:14.066833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe312d5-d8af-42ca-acea-ab5aa564bf41 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:14.078298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93f9c6-faf2-44f1-aad4-929fa0ba2cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.080691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93f9c6-faf2-44f1-aad4-929fa0ba2cd8 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.092631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 828/1628] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:14.093849 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93f9c6-faf2-44f1-aad4-929fa0ba2cd8 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:14.107197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93f9c6-faf2-44f1-aad4-929fa0ba2cd8 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:14.114225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc8db9-b267-491c-90f6-62248a8e4073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:14.114225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc8db9-b267-491c-90f6-62248a8e4073 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.114225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc8db9-b267-491c-90f6-62248a8e4073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.115111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc8db9-b267-491c-90f6-62248a8e4073 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.115921 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc8db9-b267-491c-90f6-62248a8e4073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.118689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc8db9-b267-491c-90f6-62248a8e4073 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.170141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe312d5-d8af-42ca-acea-ab5aa564bf41 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:14.174779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be44e7-2e77-43da-9cb9-09e320fe4757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:14.175440 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be44e7-2e77-43da-9cb9-09e320fe4757 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.176065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be44e7-2e77-43da-9cb9-09e320fe4757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.176295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be44e7-2e77-43da-9cb9-09e320fe4757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.187470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be44e7-2e77-43da-9cb9-09e320fe4757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.189922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be44e7-2e77-43da-9cb9-09e320fe4757 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.201511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 801/1629] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:14.202804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be44e7-2e77-43da-9cb9-09e320fe4757 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:14.216312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 829/1630] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:14 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:14.217535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc8db9-b267-491c-90f6-62248a8e4073 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:14.232333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be44e7-2e77-43da-9cb9-09e320fe4757 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:14.246772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb8608-b496-4f3c-bcaa-6624fbe7f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:14.247657 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb8608-b496-4f3c-bcaa-6624fbe7f6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.248104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb8608-b496-4f3c-bcaa-6624fbe7f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.248372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb8608-b496-4f3c-bcaa-6624fbe7f6d0 admin admin] PATH_INFO: `/v3/projects/e7adc512eaf644b98317a0e5acdfeb73/users/121237d295484812b329bbda17a3959e/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.254383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb8608-b496-4f3c-bcaa-6624fbe7f6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7adc512eaf644b98317a0e5acdfeb73, user_id=121237d295484812b329bbda17a3959e, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.259525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb8608-b496-4f3c-bcaa-6624fbe7f6d0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.286832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 802/1631] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:14 2022] PUT /identity/v3/projects/e7adc512eaf644b98317a0e5acdfeb73/users/121237d295484812b329bbda17a3959e/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:14.287648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb8608-b496-4f3c-bcaa-6624fbe7f6d0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:14.337224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc8db9-b267-491c-90f6-62248a8e4073 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:14.386820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb8608-b496-4f3c-bcaa-6624fbe7f6d0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:14.393301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b14c0a-9279-4f20-9c03-abcb23abb6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:14.394014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b14c0a-9279-4f20-9c03-abcb23abb6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.394444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b14c0a-9279-4f20-9c03-abcb23abb6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.394790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b14c0a-9279-4f20-9c03-abcb23abb6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.395522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b14c0a-9279-4f20-9c03-abcb23abb6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.397207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b14c0a-9279-4f20-9c03-abcb23abb6ae admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.411840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 803/1632] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:14.412434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa915-9c02-4cc4-9f13-1f83fd4ded9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:14.412434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa915-9c02-4cc4-9f13-1f83fd4ded9e service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.412434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa915-9c02-4cc4-9f13-1f83fd4ded9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.412434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa915-9c02-4cc4-9f13-1f83fd4ded9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.412810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5790-1e2e-4edc-ae81-75f2cd2d4922 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.412810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5790-1e2e-4edc-ae81-75f2cd2d4922 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.412810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5790-1e2e-4edc-ae81-75f2cd2d4922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.456131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c06e5790-1e2e-4edc-ae81-75f2cd2d4922 None None] MFA Rules not processed for user `121237d295484812b329bbda17a3959e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:14.457979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c06e5790-1e2e-4edc-ae81-75f2cd2d4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:14.474408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:14.505346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fa915-9c02-4cc4-9f13-1f83fd4ded9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.507653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fa915-9c02-4cc4-9f13-1f83fd4ded9e service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.522721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 830/1633] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:14.525330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12e58c-3c9d-4b60-bac3-03615e0cfa23 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.525677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12e58c-3c9d-4b60-bac3-03615e0cfa23 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.526027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12e58c-3c9d-4b60-bac3-03615e0cfa23 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.534609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 831/1634] 10.222.0.33 () {54 vars in 912 bytes} [Tue Oct 4 09:01:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:01:14.534609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12e58c-3c9d-4b60-bac3-03615e0cfa23 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:14.546288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:14.555228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12e58c-3c9d-4b60-bac3-03615e0cfa23 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:14.565716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872e05-886e-4361-9ae6-f944b87debfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:14.567764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872e05-886e-4361-9ae6-f944b87debfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.568597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872e05-886e-4361-9ae6-f944b87debfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.569912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872e05-886e-4361-9ae6-f944b87debfd admin admin] PATH_INFO: `/v3/projects/7c3ad8edede5456fb96743a19f5fadd7/users/2c195120a6b548ae9a3ede7d1b06f458/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.603863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 804/1635] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:14.609172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323d180-9a0d-4c1d-b5e4-e7c0666b197f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.609172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323d180-9a0d-4c1d-b5e4-e7c0666b197f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.609172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323d180-9a0d-4c1d-b5e4-e7c0666b197f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.615513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62872e05-886e-4361-9ae6-f944b87debfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3ad8edede5456fb96743a19f5fadd7, user_id=2c195120a6b548ae9a3ede7d1b06f458, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.618391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62872e05-886e-4361-9ae6-f944b87debfd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.637665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c323d180-9a0d-4c1d-b5e4-e7c0666b197f None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:14.638969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c323d180-9a0d-4c1d-b5e4-e7c0666b197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:14.657457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 805/1636] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:01:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:14.758938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 832/1637] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:14 2022] PUT /identity/v3/projects/7c3ad8edede5456fb96743a19f5fadd7/users/2c195120a6b548ae9a3ede7d1b06f458/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:14.760412 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323d180-9a0d-4c1d-b5e4-e7c0666b197f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:14.779454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323d180-9a0d-4c1d-b5e4-e7c0666b197f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:14.850561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612e2b9-25f1-4ae3-886a-74b152692fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:14.863536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e2b9-25f1-4ae3-886a-74b152692fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.863836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e2b9-25f1-4ae3-886a-74b152692fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.864120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612e2b9-25f1-4ae3-886a-74b152692fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.867361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e2b9-25f1-4ae3-886a-74b152692fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.869088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612e2b9-25f1-4ae3-886a-74b152692fbc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.899857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 806/1638] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:14.903919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872e05-886e-4361-9ae6-f944b87debfd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:14.915405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62872e05-886e-4361-9ae6-f944b87debfd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:14.920263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e0bb8-e4d3-4913-bfb5-43a736c049ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:14.922256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e0bb8-e4d3-4913-bfb5-43a736c049ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.922256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e0bb8-e4d3-4913-bfb5-43a736c049ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.922256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e0bb8-e4d3-4913-bfb5-43a736c049ce admin admin] PATH_INFO: `/v3/projects/7c3ad8edede5456fb96743a19f5fadd7/users/2c195120a6b548ae9a3ede7d1b06f458/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:14.924352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e0bb8-e4d3-4913-bfb5-43a736c049ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3ad8edede5456fb96743a19f5fadd7, user_id=2c195120a6b548ae9a3ede7d1b06f458, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:14.927408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e0bb8-e4d3-4913-bfb5-43a736c049ce admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:14.949512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 833/1639] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:14 2022] PUT /identity/v3/projects/7c3ad8edede5456fb96743a19f5fadd7/users/2c195120a6b548ae9a3ede7d1b06f458/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:14.952117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c03bb-a2f4-412e-a3e4-3bf71f3ef79c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:14.952589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c03bb-a2f4-412e-a3e4-3bf71f3ef79c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:14.953716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c03bb-a2f4-412e-a3e4-3bf71f3ef79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:15.034861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-428c03bb-a2f4-412e-a3e4-3bf71f3ef79c None None] MFA Rules not processed for user `2c195120a6b548ae9a3ede7d1b06f458`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:15.036114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-428c03bb-a2f4-412e-a3e4-3bf71f3ef79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:15.041003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e0bb8-e4d3-4913-bfb5-43a736c049ce admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:15.125646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e0bb8-e4d3-4913-bfb5-43a736c049ce admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:15.130781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a6cb2-a107-43ac-8c24-74e18a92b734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:15.131404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a6cb2-a107-43ac-8c24-74e18a92b734 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:15.131976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a6cb2-a107-43ac-8c24-74e18a92b734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:15.132265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a6cb2-a107-43ac-8c24-74e18a92b734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:15.134327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 807/1640] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:15.210583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a6cb2-a107-43ac-8c24-74e18a92b734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:15.212238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a6cb2-a107-43ac-8c24-74e18a92b734 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:15.239262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 834/1641] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:01:15.357051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c03bb-a2f4-412e-a3e4-3bf71f3ef79c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:15.369388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c03bb-a2f4-412e-a3e4-3bf71f3ef79c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:15.373320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e9eb2-29f0-42a7-8c14-4cfc973d4a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:15.376653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e9eb2-29f0-42a7-8c14-4cfc973d4a25 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:15.376653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e9eb2-29f0-42a7-8c14-4cfc973d4a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:15.376653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e9eb2-29f0-42a7-8c14-4cfc973d4a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:15.442177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:15.485659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e9eb2-29f0-42a7-8c14-4cfc973d4a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:15.488520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e9eb2-29f0-42a7-8c14-4cfc973d4a25 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:15.512904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 808/1642] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:15.555340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a6cb2-a107-43ac-8c24-74e18a92b734 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:15.567158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a6cb2-a107-43ac-8c24-74e18a92b734 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:15.578609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f14bc2-346c-477a-bfd3-7e24e2c33a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:15.579245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f14bc2-346c-477a-bfd3-7e24e2c33a3c service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:15.582558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f14bc2-346c-477a-bfd3-7e24e2c33a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:15.585214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f14bc2-346c-477a-bfd3-7e24e2c33a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:15.661887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:15.683612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f14bc2-346c-477a-bfd3-7e24e2c33a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:15.685890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f14bc2-346c-477a-bfd3-7e24e2c33a3c service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:15.718703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 835/1643] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:20.777139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e9eb2-29f0-42a7-8c14-4cfc973d4a25 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:20.787182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e9eb2-29f0-42a7-8c14-4cfc973d4a25 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:20.793870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e40a5d-412a-4b76-9aa7-d4991d79f603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:20.795687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e40a5d-412a-4b76-9aa7-d4991d79f603 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:20.797775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e40a5d-412a-4b76-9aa7-d4991d79f603 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:20.798395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e40a5d-412a-4b76-9aa7-d4991d79f603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:20.828113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e40a5d-412a-4b76-9aa7-d4991d79f603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:20.829839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e40a5d-412a-4b76-9aa7-d4991d79f603 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:20.857810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 809/1644] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:20.903629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f14bc2-346c-477a-bfd3-7e24e2c33a3c service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:21.079837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f14bc2-346c-477a-bfd3-7e24e2c33a3c service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:21.084820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:21.086022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:21.086022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:21.086329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] PATH_INFO: `/v3/users/79699b64c17945a681b3c5336fa0273b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:21.088669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79699b64c17945a681b3c5336fa0273b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:21.088818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 09:01:21.088818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: warnings.warn(msg) Oct 04 09:01:21.088818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: Oct 04 09:01:21.090271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:21.429282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79699b64c17945a681b3c5336fa0273b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:21.431865 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79699b64c17945a681b3c5336fa0273b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:21.469599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79699b64c17945a681b3c5336fa0273b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:21.573175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79699b64c17945a681b3c5336fa0273b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:21.575395 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79699b64c17945a681b3c5336fa0273b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:21.634193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 836/1645] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:20 2022] DELETE /identity/v3/users/79699b64c17945a681b3c5336fa0273b => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:21.637444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70279b-e790-40a9-b254-415c7ff6f575 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:21.637786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70279b-e790-40a9-b254-415c7ff6f575 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:21.638056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70279b-e790-40a9-b254-415c7ff6f575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:21.670899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3c70279b-e790-40a9-b254-415c7ff6f575 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:21.672858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3c70279b-e790-40a9-b254-415c7ff6f575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:21.894341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 810/1646] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:01:21.939394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:21.940743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:22.069249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9ef77-7733-46e0-b37e-8cb0ce6a9400 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:22.075111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aea62-12a6-41e8-8769-f77783a19e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:22.077251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aea62-12a6-41e8-8769-f77783a19e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:22.077840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aea62-12a6-41e8-8769-f77783a19e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:22.079338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aea62-12a6-41e8-8769-f77783a19e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:22.132788 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2aea62-12a6-41e8-8769-f77783a19e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:22.134715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2aea62-12a6-41e8-8769-f77783a19e98 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:22.171650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 837/1647] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:23.213274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70279b-e790-40a9-b254-415c7ff6f575 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:23.214759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3c70279b-e790-40a9-b254-415c7ff6f575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:23.240460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70279b-e790-40a9-b254-415c7ff6f575 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:23.272156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:23.272930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:23.273318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:23.273696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] PATH_INFO: `/v3/users/19654e46b7f34b2bbed41f691d3d9c5a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:23.276234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19654e46b7f34b2bbed41f691d3d9c5a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:23.280662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:23.560714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19654e46b7f34b2bbed41f691d3d9c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:23.561955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19654e46b7f34b2bbed41f691d3d9c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:23.579420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19654e46b7f34b2bbed41f691d3d9c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:23.587960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19654e46b7f34b2bbed41f691d3d9c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:23.629920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19654e46b7f34b2bbed41f691d3d9c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:23.718751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 811/1648] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:23 2022] DELETE /identity/v3/users/19654e46b7f34b2bbed41f691d3d9c5a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:23.720487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb733c8-b004-4ef7-bab9-5421a14f8e49 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:23.721732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb733c8-b004-4ef7-bab9-5421a14f8e49 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:23.721732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb733c8-b004-4ef7-bab9-5421a14f8e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:23.735810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:23.740151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:23.742111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:23.770738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ccb733c8-b004-4ef7-bab9-5421a14f8e49 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:23.779183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ccb733c8-b004-4ef7-bab9-5421a14f8e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:23.888416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:23.913475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 838/1649] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:23.970395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2f59d-ea1e-47b3-926b-b66c616952b4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:23.976823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:23.977517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:23.977781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:23.978241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] PATH_INFO: `/v3/users/3dc1c615c8454fd28998a0df026de0f9` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:23.980008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc1c615c8454fd28998a0df026de0f9)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:23.982262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:24.063729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb733c8-b004-4ef7-bab9-5421a14f8e49 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:24.065787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ccb733c8-b004-4ef7-bab9-5421a14f8e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:24.212914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb733c8-b004-4ef7-bab9-5421a14f8e49 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:24.218345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc1c615c8454fd28998a0df026de0f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:24.221277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc1c615c8454fd28998a0df026de0f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:24.230285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6711a9-9d21-4dd4-8ad3-99891fad30b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:24.230285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6711a9-9d21-4dd4-8ad3-99891fad30b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:24.230285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6711a9-9d21-4dd4-8ad3-99891fad30b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:24.230285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6711a9-9d21-4dd4-8ad3-99891fad30b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:24.235366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc1c615c8454fd28998a0df026de0f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:24.236077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc1c615c8454fd28998a0df026de0f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:24.251581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6711a9-9d21-4dd4-8ad3-99891fad30b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:24.255523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6711a9-9d21-4dd4-8ad3-99891fad30b7 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:24.289406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 839/1650] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:24.292408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bdbd2-f181-447e-a500-bd44acc4cb1d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:24.292916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bdbd2-f181-447e-a500-bd44acc4cb1d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:24.295718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bdbd2-f181-447e-a500-bd44acc4cb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:24.316248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc1c615c8454fd28998a0df026de0f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:24.340028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-af5bdbd2-f181-447e-a500-bd44acc4cb1d None None] MFA Rules not processed for user `d8e640ff14a24cb78969f3601ec8f3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:24.341472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-af5bdbd2-f181-447e-a500-bd44acc4cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:24.401265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 812/1651] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:23 2022] DELETE /identity/v3/users/3dc1c615c8454fd28998a0df026de0f9 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:24.402421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:24.414100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:24.537918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 840/1652] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:24.551368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd6cc4-0df7-482e-a231-5c1118c27b5c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:24.551816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd6cc4-0df7-482e-a231-5c1118c27b5c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:24.552193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd6cc4-0df7-482e-a231-5c1118c27b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:24.577677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-07cd6cc4-0df7-482e-a231-5c1118c27b5c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:24.579302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-07cd6cc4-0df7-482e-a231-5c1118c27b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:24.604131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea9c7c-440e-43ba-bcf7-d33e578a084b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:24.617452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:24.621262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:24.621590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:24.622053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] PATH_INFO: `/v3/projects/95f7f86e0f85418585888bb3b8c403cd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:24.625563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f7f86e0f85418585888bb3b8c403cd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:24.628882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 09:01:24.628882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: warnings.warn(msg) Oct 04 09:01:24.628882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: Oct 04 09:01:24.630996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:24.648505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:24.689212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 841/1653] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:24.693299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd27cd-c026-49a1-85c1-f61c0b486f07 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:24.694202 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd27cd-c026-49a1-85c1-f61c0b486f07 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:24.694586 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd27cd-c026-49a1-85c1-f61c0b486f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:24.728129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3fbd27cd-c026-49a1-85c1-f61c0b486f07 None None] MFA Rules not processed for user `d8e640ff14a24cb78969f3601ec8f3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:24.729687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3fbd27cd-c026-49a1-85c1-f61c0b486f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:24.818203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 842/1654] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:24.819652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd27cd-c026-49a1-85c1-f61c0b486f07 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:24.821490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3fbd27cd-c026-49a1-85c1-f61c0b486f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:24.866678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f7f86e0f85418585888bb3b8c403cd', 'request_id': 'req-27e4d78c-8191-444c-932b-5c2dbef4c7be'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:24.917297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f7f86e0f85418585888bb3b8c403cd', 'request_id': 'req-27e4d78c-8191-444c-932b-5c2dbef4c7be'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:24.930935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:24.934321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f7f86e0f85418585888bb3b8c403cd', 'request_id': 'req-27e4d78c-8191-444c-932b-5c2dbef4c7be'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:24.964108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd27cd-c026-49a1-85c1-f61c0b486f07 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:25.024048 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] The token cache is being invalidate because project 95f7f86e0f85418585888bb3b8c403cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:25.025587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:25.026643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:25.036052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 813/1655] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:24 2022] DELETE /identity/v3/projects/95f7f86e0f85418585888bb3b8c403cd => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:25.037422 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:25.044496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:25.121034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36626579-dabe-46d6-9dbd-15ea9e432651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:25.122709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626579-dabe-46d6-9dbd-15ea9e432651 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:25.123114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626579-dabe-46d6-9dbd-15ea9e432651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:25.123545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626579-dabe-46d6-9dbd-15ea9e432651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:25.126291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-36626579-dabe-46d6-9dbd-15ea9e432651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:25.227270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:25.255213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36626579-dabe-46d6-9dbd-15ea9e432651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:25.256713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36626579-dabe-46d6-9dbd-15ea9e432651 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:25.322156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 843/1656] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:25.323400 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4d78c-8191-444c-932b-5c2dbef4c7be admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:25.323837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c04226-223f-4232-8d82-017dcb676813 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:25.330293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa5270-2147-49a7-8602-8f76684e97a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:25.331458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa5270-2147-49a7-8602-8f76684e97a5 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:25.331755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa5270-2147-49a7-8602-8f76684e97a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:25.332084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa5270-2147-49a7-8602-8f76684e97a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:25.334035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-60aa5270-2147-49a7-8602-8f76684e97a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:25.337127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c04226-223f-4232-8d82-017dcb676813 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:25.345405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c04226-223f-4232-8d82-017dcb676813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:25.456765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-13c04226-223f-4232-8d82-017dcb676813 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:25.461484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa5270-2147-49a7-8602-8f76684e97a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:25.463024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-13c04226-223f-4232-8d82-017dcb676813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:25.466351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa5270-2147-49a7-8602-8f76684e97a5 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:25.495888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 844/1657] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:25.504558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 814/1658] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:25.505771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7462b4c-90a8-4979-aaa9-3fdcdf591a72 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:25.512781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7462b4c-90a8-4979-aaa9-3fdcdf591a72 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:25.516694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7462b4c-90a8-4979-aaa9-3fdcdf591a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:25.587015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b7462b4c-90a8-4979-aaa9-3fdcdf591a72 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:25.597882 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b7462b4c-90a8-4979-aaa9-3fdcdf591a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:25.657762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa5270-2147-49a7-8602-8f76684e97a5 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:25.672871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 845/1659] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:25.676774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa5270-2147-49a7-8602-8f76684e97a5 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:25.715478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722153b-be79-45ed-802b-4ba5d4138031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:25.716296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722153b-be79-45ed-802b-4ba5d4138031 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:25.718870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722153b-be79-45ed-802b-4ba5d4138031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:25.721692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722153b-be79-45ed-802b-4ba5d4138031 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:25.722677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722153b-be79-45ed-802b-4ba5d4138031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:25.724251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722153b-be79-45ed-802b-4ba5d4138031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:25.730056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7722153b-be79-45ed-802b-4ba5d4138031 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:25.773399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 815/1660] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 09:01:25.779679 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7462b4c-90a8-4979-aaa9-3fdcdf591a72 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:25.792390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7462b4c-90a8-4979-aaa9-3fdcdf591a72 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:25.807628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f2144-271e-4a4c-be71-699570598287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:25.808454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f2144-271e-4a4c-be71-699570598287 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:25.808743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f2144-271e-4a4c-be71-699570598287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:25.809018 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f2144-271e-4a4c-be71-699570598287 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:25.809920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f2144-271e-4a4c-be71-699570598287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:25.830627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f2144-271e-4a4c-be71-699570598287 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:25.988398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 846/1661] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:25 2022] POST /identity/v3/projects => generated 405 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:25.992346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722153b-be79-45ed-802b-4ba5d4138031 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:26.006832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722153b-be79-45ed-802b-4ba5d4138031 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:26.051657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f2144-271e-4a4c-be71-699570598287 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:26.053498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b90f2144-271e-4a4c-be71-699570598287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:26.220098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcea3b4-ea8d-407c-9036-96028df1a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:26.220726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcea3b4-ea8d-407c-9036-96028df1a60b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.221006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcea3b4-ea8d-407c-9036-96028df1a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.221277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcea3b4-ea8d-407c-9036-96028df1a60b admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.221983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcea3b4-ea8d-407c-9036-96028df1a60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:26.249744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcea3b4-ea8d-407c-9036-96028df1a60b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:26.284574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f2144-271e-4a4c-be71-699570598287 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:26.302384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:26.303852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.304285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.304692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] PATH_INFO: `/v3/projects/0c48864043694126aa6c52e86c887ad1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.306144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c48864043694126aa6c52e86c887ad1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:26.309253 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:26.373068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 816/1662] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:25 2022] POST /identity/v3/users => generated 303 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:26.377550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcea3b4-ea8d-407c-9036-96028df1a60b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:26.405684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:26.425481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcea3b4-ea8d-407c-9036-96028df1a60b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:26.444873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b022000-ff8f-4af7-8a77-6e94c73bc08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:26.453547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b022000-ff8f-4af7-8a77-6e94c73bc08d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.453998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b022000-ff8f-4af7-8a77-6e94c73bc08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.456684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b022000-ff8f-4af7-8a77-6e94c73bc08d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.460369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b022000-ff8f-4af7-8a77-6e94c73bc08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:26.465019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b022000-ff8f-4af7-8a77-6e94c73bc08d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:26.511170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c48864043694126aa6c52e86c887ad1', 'request_id': 'req-ef9420ed-206c-4a65-9489-5b2a0e95292c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:26.515695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 817/1663] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:26.523911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b022000-ff8f-4af7-8a77-6e94c73bc08d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:26.551269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c48864043694126aa6c52e86c887ad1', 'request_id': 'req-ef9420ed-206c-4a65-9489-5b2a0e95292c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:26.565443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b022000-ff8f-4af7-8a77-6e94c73bc08d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:26.641429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c48864043694126aa6c52e86c887ad1', 'request_id': 'req-ef9420ed-206c-4a65-9489-5b2a0e95292c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:26.655727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2501c98-0384-4fa5-b063-607857d09ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:26.656384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2501c98-0384-4fa5-b063-607857d09ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.658289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2501c98-0384-4fa5-b063-607857d09ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.658289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2501c98-0384-4fa5-b063-607857d09ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.659563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2501c98-0384-4fa5-b063-607857d09ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:26.661019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] The token cache is being invalidate because project 0c48864043694126aa6c52e86c887ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:26.661316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:26.663637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2501c98-0384-4fa5-b063-607857d09ee9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:26.665534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef9420ed-206c-4a65-9489-5b2a0e95292c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:26.668311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 847/1664] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:26 2022] DELETE /identity/v3/projects/0c48864043694126aa6c52e86c887ad1 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:01:26.674156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baacac1-00c7-4012-a64b-d8e92ebbc0d8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.674598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baacac1-00c7-4012-a64b-d8e92ebbc0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.674753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baacac1-00c7-4012-a64b-d8e92ebbc0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.695787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 818/1665] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:26.699358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2501c98-0384-4fa5-b063-607857d09ee9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:26.707413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e2501c98-0384-4fa5-b063-607857d09ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:26.723653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6baacac1-00c7-4012-a64b-d8e92ebbc0d8 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:26.725217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6baacac1-00c7-4012-a64b-d8e92ebbc0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:26.731767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2501c98-0384-4fa5-b063-607857d09ee9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:26.743593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f2b17-d617-472c-b1eb-97c75b2549f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:26.753763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 848/1666] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:26.755039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f2b17-d617-472c-b1eb-97c75b2549f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.755432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f2b17-d617-472c-b1eb-97c75b2549f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.755723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f2b17-d617-472c-b1eb-97c75b2549f8 admin admin] PATH_INFO: `/v3/projects/ce348820fd49431480cccf45a540e91f/users/72ef14cd721547e19bd00da58fe146ca/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.757308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8726c-58da-48bd-bf2f-f6860b75e06a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.758241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8726c-58da-48bd-bf2f-f6860b75e06a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.758529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8726c-58da-48bd-bf2f-f6860b75e06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.798691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f2b17-d617-472c-b1eb-97c75b2549f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce348820fd49431480cccf45a540e91f, user_id=72ef14cd721547e19bd00da58fe146ca, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:26.804323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f2b17-d617-472c-b1eb-97c75b2549f8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:26.808376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f3a8726c-58da-48bd-bf2f-f6860b75e06a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:26.809904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f3a8726c-58da-48bd-bf2f-f6860b75e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:26.823462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 849/1667] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:26.825675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09563090-da94-42c4-9747-0ba5f4f96100 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.826150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09563090-da94-42c4-9747-0ba5f4f96100 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.826569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09563090-da94-42c4-9747-0ba5f4f96100 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.828189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 850/1668] 10.222.0.33 () {54 vars in 912 bytes} [Tue Oct 4 09:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:01:26.829125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09563090-da94-42c4-9747-0ba5f4f96100 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:26.870423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09563090-da94-42c4-9747-0ba5f4f96100 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:26.885172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1578486-7194-4747-ac5b-c4fa0fca64ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:26.886349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1578486-7194-4747-ac5b-c4fa0fca64ea admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.892456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1578486-7194-4747-ac5b-c4fa0fca64ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.894471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1578486-7194-4747-ac5b-c4fa0fca64ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.895357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1578486-7194-4747-ac5b-c4fa0fca64ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:26.896105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1578486-7194-4747-ac5b-c4fa0fca64ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:26.900321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1578486-7194-4747-ac5b-c4fa0fca64ea admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:26.921092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 819/1669] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:26 2022] PUT /identity/v3/projects/ce348820fd49431480cccf45a540e91f/users/72ef14cd721547e19bd00da58fe146ca/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:26.923753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e5d69-556f-4b6c-acbf-a4df9e70ac77 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.924195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e5d69-556f-4b6c-acbf-a4df9e70ac77 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.928214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e5d69-556f-4b6c-acbf-a4df9e70ac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.936751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 851/1670] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:26.936751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d0f6-0519-4194-b0d6-5f524b048f6b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:26.936751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d0f6-0519-4194-b0d6-5f524b048f6b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:26.946715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d0f6-0519-4194-b0d6-5f524b048f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:26.999846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-91a2d0f6-0519-4194-b0d6-5f524b048f6b None None] MFA Rules not processed for user `72ef14cd721547e19bd00da58fe146ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:27.001226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-91a2d0f6-0519-4194-b0d6-5f524b048f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:27.016875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:27.017947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6d2e5d69-556f-4b6c-acbf-a4df9e70ac77 None None] MFA Rules not processed for user `e0b66989d4df4398ad723f587cbc24bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:27.019390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6d2e5d69-556f-4b6c-acbf-a4df9e70ac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:27.124664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 852/1671] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:27.124664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d0f6-0519-4194-b0d6-5f524b048f6b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:27.150401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 820/1672] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:27.151417 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e5d69-556f-4b6c-acbf-a4df9e70ac77 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:27.294249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d0f6-0519-4194-b0d6-5f524b048f6b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:27.314112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87d2d4-2314-4f34-bca3-a6ac4f05dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:27.319204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87d2d4-2314-4f34-bca3-a6ac4f05dc30 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:27.319204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87d2d4-2314-4f34-bca3-a6ac4f05dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:27.319204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87d2d4-2314-4f34-bca3-a6ac4f05dc30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:27.319204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87d2d4-2314-4f34-bca3-a6ac4f05dc30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:27.319204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87d2d4-2314-4f34-bca3-a6ac4f05dc30 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:27.335190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e5d69-556f-4b6c-acbf-a4df9e70ac77 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:27.372656 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252565e-2fb9-4b2e-b725-fd50f22e927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:27.373698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252565e-2fb9-4b2e-b725-fd50f22e927c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:27.374658 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252565e-2fb9-4b2e-b725-fd50f22e927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:27.375082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252565e-2fb9-4b2e-b725-fd50f22e927c admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:27.376538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252565e-2fb9-4b2e-b725-fd50f22e927c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:27.378656 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252565e-2fb9-4b2e-b725-fd50f22e927c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:27.467499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 853/1673] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:27 2022] POST /identity/v3/projects => generated 373 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:27.468411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87d2d4-2314-4f34-bca3-a6ac4f05dc30 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:27.479048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bf87d2d4-2314-4f34-bca3-a6ac4f05dc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:27.507707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 821/1674] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:27 2022] POST /identity/v3/projects => generated 403 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:27.509176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252565e-2fb9-4b2e-b725-fd50f22e927c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:27.520964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f252565e-2fb9-4b2e-b725-fd50f22e927c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:27.697331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87d2d4-2314-4f34-bca3-a6ac4f05dc30 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:27.719135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252565e-2fb9-4b2e-b725-fd50f22e927c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:27.738039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:27.738916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:27.739342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:27.739825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] PATH_INFO: `/v3/projects/0184c2c3d1b547ec82cfc66588e40684` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:27.742012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0184c2c3d1b547ec82cfc66588e40684)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:27.748000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:27.869188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5acd0-fca3-4d30-abf7-6d594a0ff7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:27.869972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5acd0-fca3-4d30-abf7-6d594a0ff7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:27.870889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5acd0-fca3-4d30-abf7-6d594a0ff7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:27.871239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5acd0-fca3-4d30-abf7-6d594a0ff7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:27.882699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5acd0-fca3-4d30-abf7-6d594a0ff7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:27.884373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5acd0-fca3-4d30-abf7-6d594a0ff7f3 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:27.899214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 854/1675] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:27.900270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5acd0-fca3-4d30-abf7-6d594a0ff7f3 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:27.914185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5acd0-fca3-4d30-abf7-6d594a0ff7f3 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:27.916566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0184c2c3d1b547ec82cfc66588e40684', 'request_id': 'req-ac82799c-b091-4b13-bdec-16e5e6562c0f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:27.947856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0184c2c3d1b547ec82cfc66588e40684', 'request_id': 'req-ac82799c-b091-4b13-bdec-16e5e6562c0f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:27.954941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0184c2c3d1b547ec82cfc66588e40684', 'request_id': 'req-ac82799c-b091-4b13-bdec-16e5e6562c0f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:28.021732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d66894-7a15-4dbd-9a2e-b2e5420d5d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:28.022639 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d66894-7a15-4dbd-9a2e-b2e5420d5d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.023033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d66894-7a15-4dbd-9a2e-b2e5420d5d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.023443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d66894-7a15-4dbd-9a2e-b2e5420d5d5d admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.024355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d66894-7a15-4dbd-9a2e-b2e5420d5d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:28.026489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d66894-7a15-4dbd-9a2e-b2e5420d5d5d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:28.062241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] The token cache is being invalidate because project 0184c2c3d1b547ec82cfc66588e40684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:28.062537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:28.063401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:28.065178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 822/1676] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:27 2022] DELETE /identity/v3/projects/0184c2c3d1b547ec82cfc66588e40684 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:28.066234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:28.067645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:28.087781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82799c-b091-4b13-bdec-16e5e6562c0f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:28.092975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa462-93af-4e08-8225-640fa023f868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:28.093603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa462-93af-4e08-8225-640fa023f868 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.093884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa462-93af-4e08-8225-640fa023f868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.094193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa462-93af-4e08-8225-640fa023f868 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.094841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa462-93af-4e08-8225-640fa023f868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:28.097675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa462-93af-4e08-8225-640fa023f868 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:28.151834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 855/1677] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:27 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:28.152867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33ef4c-68f1-4057-961e-80b90e26688a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.153102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33ef4c-68f1-4057-961e-80b90e26688a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.153491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33ef4c-68f1-4057-961e-80b90e26688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.197440 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:28.224136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8f33ef4c-68f1-4057-961e-80b90e26688a None None] MFA Rules not processed for user `25274e19c10c4e8fb35b37f06e6bfdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:28.225374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8f33ef4c-68f1-4057-961e-80b90e26688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:28.227228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 823/1678] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:28 2022] POST /identity/v3/users => generated 308 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:28.232179 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa462-93af-4e08-8225-640fa023f868 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:28.235326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f75aa462-93af-4e08-8225-640fa023f868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:28.265180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa462-93af-4e08-8225-640fa023f868 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:28.280456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:28.281493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.281977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.283859 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] PATH_INFO: `/v3/users/121237d295484812b329bbda17a3959e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.287740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121237d295484812b329bbda17a3959e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:28.295049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:28.340101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:28.397175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 856/1679] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:28.398332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33ef4c-68f1-4057-961e-80b90e26688a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:28.399874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8f33ef4c-68f1-4057-961e-80b90e26688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:28.415356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33ef4c-68f1-4057-961e-80b90e26688a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:28.428809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6417aa-34f9-41db-8344-5e434004f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:28.428809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6417aa-34f9-41db-8344-5e434004f288 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.428809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6417aa-34f9-41db-8344-5e434004f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.428809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6417aa-34f9-41db-8344-5e434004f288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.429074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6417aa-34f9-41db-8344-5e434004f288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:28.430020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6417aa-34f9-41db-8344-5e434004f288 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:28.446871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 857/1680] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:28.446871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0578b-30b8-4df5-b1aa-cda5f499069d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.446871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0578b-30b8-4df5-b1aa-cda5f499069d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.446871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0578b-30b8-4df5-b1aa-cda5f499069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.487709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b9b0578b-30b8-4df5-b1aa-cda5f499069d None None] MFA Rules not processed for user `7d1240c674d74311b58fcafe2886ef2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:28.489281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9b0578b-30b8-4df5-b1aa-cda5f499069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:28.559608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121237d295484812b329bbda17a3959e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:28.562526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121237d295484812b329bbda17a3959e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:28.585071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121237d295484812b329bbda17a3959e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:28.586620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121237d295484812b329bbda17a3959e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:28.599493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 858/1681] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:28.600768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0578b-30b8-4df5-b1aa-cda5f499069d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:28.614346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121237d295484812b329bbda17a3959e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:28.618249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0578b-30b8-4df5-b1aa-cda5f499069d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:28.625200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daee052-46ca-4c22-97f0-49c40cef1b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:28.626277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee052-46ca-4c22-97f0-49c40cef1b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.626839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee052-46ca-4c22-97f0-49c40cef1b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.628881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daee052-46ca-4c22-97f0-49c40cef1b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.633330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daee052-46ca-4c22-97f0-49c40cef1b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:28.639685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daee052-46ca-4c22-97f0-49c40cef1b26 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:28.659326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 859/1682] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:28.659326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daee052-46ca-4c22-97f0-49c40cef1b26 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:28.662927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3daee052-46ca-4c22-97f0-49c40cef1b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:28.728431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 824/1683] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:28 2022] DELETE /identity/v3/users/121237d295484812b329bbda17a3959e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:28.729695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:28.733266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:28.774614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daee052-46ca-4c22-97f0-49c40cef1b26 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:28.885322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08918807-5cc1-4748-ad21-ab35fb9f1018 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:28.896903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864a0eb-1cad-460e-abb0-91de0db88252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:28.900241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864a0eb-1cad-460e-abb0-91de0db88252 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.901820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864a0eb-1cad-460e-abb0-91de0db88252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.909680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864a0eb-1cad-460e-abb0-91de0db88252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.917701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864a0eb-1cad-460e-abb0-91de0db88252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:28.920625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864a0eb-1cad-460e-abb0-91de0db88252 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:28.943456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=81,keystone:INSERT=5,keystone:DELETE=14 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:28.964402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 825/1684] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:28.967066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec307ee-a660-4a79-8f2c-11b805fcb132 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.968276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec307ee-a660-4a79-8f2c-11b805fcb132 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.969222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec307ee-a660-4a79-8f2c-11b805fcb132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.982797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:28.988138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:28.988138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:28.988138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:28.990279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:29.026962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-eec307ee-a660-4a79-8f2c-11b805fcb132 None None] MFA Rules not processed for user `7d1240c674d74311b58fcafe2886ef2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:29.030795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eec307ee-a660-4a79-8f2c-11b805fcb132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:29.132785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:29.162289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 826/1685] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:29.162466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:29.167492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec307ee-a660-4a79-8f2c-11b805fcb132 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:29.167613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:29.167687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eec307ee-a660-4a79-8f2c-11b805fcb132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:29.183028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec307ee-a660-4a79-8f2c-11b805fcb132 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:29.186630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 860/1686] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:29.187483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:29.188936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:29.202409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a9562-c01c-48f7-af13-07384730b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:29.203204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a9562-c01c-48f7-af13-07384730b628 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:29.203542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a9562-c01c-48f7-af13-07384730b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:29.203882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a9562-c01c-48f7-af13-07384730b628 admin admin] PATH_INFO: `/v3/projects/a31678019b5a4d47958b6c66c555267c/users/2c4353dd11b64d5fb64bd84ff562918b/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:29.215277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1425-6417-4124-9861-b7ad510c3499 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:29.228086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:29.228753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:29.229423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:29.229423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] PATH_INFO: `/v3/users/9107a7f3acbc49a2bbcbfcfa7ef8ea16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:29.230785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9107a7f3acbc49a2bbcbfcfa7ef8ea16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:29.232694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:29.239165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a9562-c01c-48f7-af13-07384730b628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31678019b5a4d47958b6c66c555267c, user_id=2c4353dd11b64d5fb64bd84ff562918b, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:29.241857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a9562-c01c-48f7-af13-07384730b628 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:29.370393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 827/1687] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:29 2022] PUT /identity/v3/projects/a31678019b5a4d47958b6c66c555267c/users/2c4353dd11b64d5fb64bd84ff562918b/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:29.373611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a9562-c01c-48f7-af13-07384730b628 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:29.458537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9107a7f3acbc49a2bbcbfcfa7ef8ea16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:29.459482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9107a7f3acbc49a2bbcbfcfa7ef8ea16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:29.485097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9107a7f3acbc49a2bbcbfcfa7ef8ea16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:29.491784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a9562-c01c-48f7-af13-07384730b628 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:29.499945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3258861-4b84-4578-a348-4c6bbbc514d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:29.501194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3258861-4b84-4578-a348-4c6bbbc514d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:29.501552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3258861-4b84-4578-a348-4c6bbbc514d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:29.502022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3258861-4b84-4578-a348-4c6bbbc514d0 admin admin] PATH_INFO: `/v3/projects/1ccfb3d86cdf4f4f8e8464ae12968ebb/users/a1cd38a2728d427e8af5c2622949c5a0/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:29.523515 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3258861-4b84-4578-a348-4c6bbbc514d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ccfb3d86cdf4f4f8e8464ae12968ebb, user_id=a1cd38a2728d427e8af5c2622949c5a0, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:29.527117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3258861-4b84-4578-a348-4c6bbbc514d0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:29.594499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9107a7f3acbc49a2bbcbfcfa7ef8ea16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:29.595795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9107a7f3acbc49a2bbcbfcfa7ef8ea16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:29.619418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 861/1688] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:29 2022] DELETE /identity/v3/users/9107a7f3acbc49a2bbcbfcfa7ef8ea16 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:29.620409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:29.621773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:29.645853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 828/1689] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:29 2022] PUT /identity/v3/projects/1ccfb3d86cdf4f4f8e8464ae12968ebb/users/a1cd38a2728d427e8af5c2622949c5a0/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:29.648609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3258861-4b84-4578-a348-4c6bbbc514d0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:29.659430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f3258861-4b84-4578-a348-4c6bbbc514d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:29.852264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3258861-4b84-4578-a348-4c6bbbc514d0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:29.859819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:29.860454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:29.861248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:29.861525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:29.866326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6023b5-bd06-4a12-9f33-ad3c6370d081 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:29.867742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:29.998859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:29.999442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:29.999607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:29.999891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:30.002132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:30.008058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:30.009876 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:30.021542 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:30.023864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:30.044829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 829/1690] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:30.047541 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:30.049112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:30.083747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 862/1691] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:30.086116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:30.097948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:30.211923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4f5e3-4872-4eaa-b886-ef97aff66a5e service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:30.226723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994be65-c405-41c8-937c-b8a9304894f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:30.228103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994be65-c405-41c8-937c-b8a9304894f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:30.233245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994be65-c405-41c8-937c-b8a9304894f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:30.234502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994be65-c405-41c8-937c-b8a9304894f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:30.235292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994be65-c405-41c8-937c-b8a9304894f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:30.242514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994be65-c405-41c8-937c-b8a9304894f0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:30.242692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9eb8f-9c28-41f7-b98c-e0c75185ad93 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:30.248478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:30.249395 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:30.249736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:30.250120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] PATH_INFO: `/v3/projects/e7adc512eaf644b98317a0e5acdfeb73` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:30.256836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7adc512eaf644b98317a0e5acdfeb73)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:30.256836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:30.275257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:30.281626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 830/1692] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:30.288887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a3ebc-86ff-496e-b423-23f720be158a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:30.289328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a3ebc-86ff-496e-b423-23f720be158a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:30.289764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a3ebc-86ff-496e-b423-23f720be158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:30.343056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4d2a3ebc-86ff-496e-b423-23f720be158a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:30.343056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4d2a3ebc-86ff-496e-b423-23f720be158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:30.372585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 831/1693] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:30.397285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be06b2-311c-4486-b193-acecb35dbd07 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:30.397498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be06b2-311c-4486-b193-acecb35dbd07 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:30.399181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be06b2-311c-4486-b193-acecb35dbd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:30.474116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7adc512eaf644b98317a0e5acdfeb73', 'request_id': 'req-4629a9c7-56fb-425f-b34e-2777ab2213dc'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:30.494378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7adc512eaf644b98317a0e5acdfeb73', 'request_id': 'req-4629a9c7-56fb-425f-b34e-2777ab2213dc'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:30.522220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:30.535882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-88be06b2-311c-4486-b193-acecb35dbd07 None None] MFA Rules not processed for user `a1cd38a2728d427e8af5c2622949c5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:30.537632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-88be06b2-311c-4486-b193-acecb35dbd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:30.606516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7adc512eaf644b98317a0e5acdfeb73', 'request_id': 'req-4629a9c7-56fb-425f-b34e-2777ab2213dc'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:30.628922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] The token cache is being invalidate because project e7adc512eaf644b98317a0e5acdfeb73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:30.629222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:30.641470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:30.645939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 863/1694] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:30 2022] DELETE /identity/v3/projects/e7adc512eaf644b98317a0e5acdfeb73 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:30.646270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:30.649757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:30.743370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 832/1695] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:30.744466 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be06b2-311c-4486-b193-acecb35dbd07 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:30.747569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-88be06b2-311c-4486-b193-acecb35dbd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:30.808630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629a9c7-56fb-425f-b34e-2777ab2213dc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:30.818810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b6167-4ca0-4b58-8e0e-400ac1fb4934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:30.819632 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b6167-4ca0-4b58-8e0e-400ac1fb4934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:30.820010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b6167-4ca0-4b58-8e0e-400ac1fb4934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:30.820383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b6167-4ca0-4b58-8e0e-400ac1fb4934 admin admin] PATH_INFO: `/v3/projects/a31678019b5a4d47958b6c66c555267c/users/2c4353dd11b64d5fb64bd84ff562918b/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:30.824647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b6167-4ca0-4b58-8e0e-400ac1fb4934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31678019b5a4d47958b6c66c555267c, user_id=2c4353dd11b64d5fb64bd84ff562918b, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:30.828496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b6167-4ca0-4b58-8e0e-400ac1fb4934 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:30.853288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 864/1696] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:30 2022] PUT /identity/v3/projects/a31678019b5a4d47958b6c66c555267c/users/2c4353dd11b64d5fb64bd84ff562918b/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:30.855407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab55771-b93f-4728-9ea3-e3e1a9a6e27d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:30.855870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab55771-b93f-4728-9ea3-e3e1a9a6e27d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:30.857576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab55771-b93f-4728-9ea3-e3e1a9a6e27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:30.873247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be06b2-311c-4486-b193-acecb35dbd07 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:30.878485 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:30.899416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eab55771-b93f-4728-9ea3-e3e1a9a6e27d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:30.900847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eab55771-b93f-4728-9ea3-e3e1a9a6e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:30.999608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb818d-17da-49ed-b124-d716f1604e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:31.000523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb818d-17da-49ed-b124-d716f1604e6e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.000811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb818d-17da-49ed-b124-d716f1604e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.001089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb818d-17da-49ed-b124-d716f1604e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.015920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ecdb818d-17da-49ed-b124-d716f1604e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:31.120062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 865/1697] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:31.121556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab55771-b93f-4728-9ea3-e3e1a9a6e27d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:31.123272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eab55771-b93f-4728-9ea3-e3e1a9a6e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:31.139555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab55771-b93f-4728-9ea3-e3e1a9a6e27d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:31.148482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3539-72dd-4194-8cdb-392f9311978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:31.149899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3539-72dd-4194-8cdb-392f9311978d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.150373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3539-72dd-4194-8cdb-392f9311978d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.150789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3539-72dd-4194-8cdb-392f9311978d admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.151621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f3539-72dd-4194-8cdb-392f9311978d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:31.157009 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f3539-72dd-4194-8cdb-392f9311978d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:31.275519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb818d-17da-49ed-b124-d716f1604e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:31.277143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb818d-17da-49ed-b124-d716f1604e6e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:31.296606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 833/1698] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:31.300217 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf1346-9b5d-4183-bb63-864ae1ee54cc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.300217 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf1346-9b5d-4183-bb63-864ae1ee54cc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.302613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf1346-9b5d-4183-bb63-864ae1ee54cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.352293 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 866/1699] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:31 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:31.353627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52d6e9-42e3-41d8-8118-61458f88ca14 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.369465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52d6e9-42e3-41d8-8118-61458f88ca14 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.371540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52d6e9-42e3-41d8-8118-61458f88ca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.419305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9d52d6e9-42e3-41d8-8118-61458f88ca14 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:31.420867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9d52d6e9-42e3-41d8-8118-61458f88ca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:31.431143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-47bf1346-9b5d-4183-bb63-864ae1ee54cc None None] MFA Rules not processed for user `2c4353dd11b64d5fb64bd84ff562918b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:31.432398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-47bf1346-9b5d-4183-bb63-864ae1ee54cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:31.578306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 867/1700] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:31.579713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52d6e9-42e3-41d8-8118-61458f88ca14 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:31.606701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52d6e9-42e3-41d8-8118-61458f88ca14 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:31.616047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab0cf-1d5b-478a-938b-756bf5789d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:31.616750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab0cf-1d5b-478a-938b-756bf5789d59 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.617113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab0cf-1d5b-478a-938b-756bf5789d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.617392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab0cf-1d5b-478a-938b-756bf5789d59 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.618152 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab0cf-1d5b-478a-938b-756bf5789d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:31.626063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab0cf-1d5b-478a-938b-756bf5789d59 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:31.640620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 834/1701] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:31.640620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf1346-9b5d-4183-bb63-864ae1ee54cc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:31.670587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf1346-9b5d-4183-bb63-864ae1ee54cc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:31.686347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:31.688367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.688774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.689134 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.693946 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:31.695698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:31.702519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:31.735264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 835/1702] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:31.738492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:31.743951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:31.775957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 868/1703] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:31 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:31.775957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab0cf-1d5b-478a-938b-756bf5789d59 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:31.793866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab0cf-1d5b-478a-938b-756bf5789d59 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:31.802842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6845-f7a4-4d55-98c9-6b012781a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:31.802842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6845-f7a4-4d55-98c9-6b012781a926 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.803718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6845-f7a4-4d55-98c9-6b012781a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.804291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6845-f7a4-4d55-98c9-6b012781a926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.804869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d6845-f7a4-4d55-98c9-6b012781a926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:31.818809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d6845-f7a4-4d55-98c9-6b012781a926 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:31.846690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c124c49-99bd-4afe-b0a2-7097b19b0eda admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:31.852699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac357e1-91bc-44e8-958f-a79f764f4824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:31.853457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac357e1-91bc-44e8-958f-a79f764f4824 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.853989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac357e1-91bc-44e8-958f-a79f764f4824 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.854393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac357e1-91bc-44e8-958f-a79f764f4824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.871373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac357e1-91bc-44e8-958f-a79f764f4824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:31.873156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac357e1-91bc-44e8-958f-a79f764f4824 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:31.885845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 836/1704] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:31 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:31.886875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac357e1-91bc-44e8-958f-a79f764f4824 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:31.899563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac357e1-91bc-44e8-958f-a79f764f4824 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:31.905358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e7b61-8d4c-4083-a44d-7592e6c53c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:31.906469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e7b61-8d4c-4083-a44d-7592e6c53c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.906869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e7b61-8d4c-4083-a44d-7592e6c53c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.907224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e7b61-8d4c-4083-a44d-7592e6c53c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.908026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e7b61-8d4c-4083-a44d-7592e6c53c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:31.910508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e7b61-8d4c-4083-a44d-7592e6c53c04 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:31.924445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 837/1705] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:31.929022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e7b61-8d4c-4083-a44d-7592e6c53c04 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:31.950490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e7b61-8d4c-4083-a44d-7592e6c53c04 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:31.957643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c49ce-f82d-4e92-a889-6e6c9c443517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:31.958519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c49ce-f82d-4e92-a889-6e6c9c443517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:31.960224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c49ce-f82d-4e92-a889-6e6c9c443517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:31.960605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c49ce-f82d-4e92-a889-6e6c9c443517 admin admin] PATH_INFO: `/v3/projects/73fd784be1c84c05bdb546868220d6a2/users/248b5e2fa9534b37850389df1b1d3677/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:31.986587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 869/1706] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:31 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:31.990685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6845-f7a4-4d55-98c9-6b012781a926 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:31.999290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c49ce-f82d-4e92-a889-6e6c9c443517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fd784be1c84c05bdb546868220d6a2, user_id=248b5e2fa9534b37850389df1b1d3677, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:32.007800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c49ce-f82d-4e92-a889-6e6c9c443517 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:32.092911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d6845-f7a4-4d55-98c9-6b012781a926 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:32.099663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0043ad-9f55-43ef-8432-61c94bd56535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:32.100537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0043ad-9f55-43ef-8432-61c94bd56535 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:32.101017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0043ad-9f55-43ef-8432-61c94bd56535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:32.101511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0043ad-9f55-43ef-8432-61c94bd56535 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:32.104037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0043ad-9f55-43ef-8432-61c94bd56535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:32.113665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0043ad-9f55-43ef-8432-61c94bd56535 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:32.116017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 838/1707] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:31 2022] PUT /identity/v3/projects/73fd784be1c84c05bdb546868220d6a2/users/248b5e2fa9534b37850389df1b1d3677/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:32.117045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c49ce-f82d-4e92-a889-6e6c9c443517 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:32.233002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:32.245746 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c49ce-f82d-4e92-a889-6e6c9c443517 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:32.258295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905f470-4f9b-4c0e-abc0-cc793c45f375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:32.261739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905f470-4f9b-4c0e-abc0-cc793c45f375 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:32.261739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905f470-4f9b-4c0e-abc0-cc793c45f375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:32.261739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905f470-4f9b-4c0e-abc0-cc793c45f375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:32.261739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905f470-4f9b-4c0e-abc0-cc793c45f375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:32.262366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905f470-4f9b-4c0e-abc0-cc793c45f375 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:32.278158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 839/1708] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:32.280323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e41a-2483-456c-b4eb-636bc530f153 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:32.280448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e41a-2483-456c-b4eb-636bc530f153 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:32.280697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4e41a-2483-456c-b4eb-636bc530f153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:32.305228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cdf4e41a-2483-456c-b4eb-636bc530f153 None None] MFA Rules not processed for user `7d1240c674d74311b58fcafe2886ef2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:32.305681 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cdf4e41a-2483-456c-b4eb-636bc530f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:32.371208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 840/1709] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:32.393845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4e41a-2483-456c-b4eb-636bc530f153 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:32.428975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4e41a-2483-456c-b4eb-636bc530f153 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:32.449908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 870/1710] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:31 2022] POST /identity/v3/users => generated 293 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:32.450908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0043ad-9f55-43ef-8432-61c94bd56535 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:32.474586 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0043ad-9f55-43ef-8432-61c94bd56535 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:32.477356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:32.484223 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:32.484223 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:32.484223 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] PATH_INFO: `/v3/users/72ef14cd721547e19bd00da58fe146ca` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:32.484223 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ef14cd721547e19bd00da58fe146ca)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:32.485336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc48e6-622a-4a84-b880-465f520131b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:32.486026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc48e6-622a-4a84-b880-465f520131b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:32.486341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc48e6-622a-4a84-b880-465f520131b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:32.487827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:32.488829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc48e6-622a-4a84-b880-465f520131b6 admin admin] PATH_INFO: `/v3/projects/73fd784be1c84c05bdb546868220d6a2/users/248b5e2fa9534b37850389df1b1d3677/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:32.496941 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc48e6-622a-4a84-b880-465f520131b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fd784be1c84c05bdb546868220d6a2, user_id=248b5e2fa9534b37850389df1b1d3677, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:32.503866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc48e6-622a-4a84-b880-465f520131b6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:32.553751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 871/1711] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:32 2022] PUT /identity/v3/projects/73fd784be1c84c05bdb546868220d6a2/users/248b5e2fa9534b37850389df1b1d3677/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:32.554905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc48e6-622a-4a84-b880-465f520131b6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:32.561579 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-84bc48e6-622a-4a84-b880-465f520131b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:32.672415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc48e6-622a-4a84-b880-465f520131b6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:32.680283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:32.680886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:32.681224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:32.681506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] PATH_INFO: `/v3/projects/ff25aa70ea07417db5df44d7c7ba49fb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:32.683981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff25aa70ea07417db5df44d7c7ba49fb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:32.686816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:32.828198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff25aa70ea07417db5df44d7c7ba49fb', 'request_id': 'req-cbff8f03-66ea-42ad-a5ba-818dd723604c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.828198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff25aa70ea07417db5df44d7c7ba49fb', 'request_id': 'req-cbff8f03-66ea-42ad-a5ba-818dd723604c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.851938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:32.856827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ef14cd721547e19bd00da58fe146ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.857536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ef14cd721547e19bd00da58fe146ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.885682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ef14cd721547e19bd00da58fe146ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.885682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ef14cd721547e19bd00da58fe146ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.904683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff25aa70ea07417db5df44d7c7ba49fb', 'request_id': 'req-cbff8f03-66ea-42ad-a5ba-818dd723604c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.916722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d58a0250-5176-47f5-be26-083b3f18819a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ef14cd721547e19bd00da58fe146ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.929177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] The token cache is being invalidate because project ff25aa70ea07417db5df44d7c7ba49fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:32.929775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.930833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:32.939313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 872/1712] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:32 2022] DELETE /identity/v3/projects/ff25aa70ea07417db5df44d7c7ba49fb => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:32.943040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:32.945056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:33.040499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff8f03-66ea-42ad-a5ba-818dd723604c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:33.062646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 841/1713] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:32 2022] DELETE /identity/v3/users/72ef14cd721547e19bd00da58fe146ca => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:33.065459 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a897318-9d2c-4cd7-9e26-1588350ccdd0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.065912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a897318-9d2c-4cd7-9e26-1588350ccdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.067451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a897318-9d2c-4cd7-9e26-1588350ccdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.070792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e9be3-e0d5-4a13-9a35-16a0398dacbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:33.072748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e9be3-e0d5-4a13-9a35-16a0398dacbe admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.074432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e9be3-e0d5-4a13-9a35-16a0398dacbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.074876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e9be3-e0d5-4a13-9a35-16a0398dacbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.076541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e9be3-e0d5-4a13-9a35-16a0398dacbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:33.080201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e9be3-e0d5-4a13-9a35-16a0398dacbe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:33.111633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 873/1714] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:33.115833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd01f-31e4-4fe2-86b3-595167a310fd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.116119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd01f-31e4-4fe2-86b3-595167a310fd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.116398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd01f-31e4-4fe2-86b3-595167a310fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.144630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3a897318-9d2c-4cd7-9e26-1588350ccdd0 None None] MFA Rules not processed for user `248b5e2fa9534b37850389df1b1d3677`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:33.145928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3a897318-9d2c-4cd7-9e26-1588350ccdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:33.241571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-907cd01f-31e4-4fe2-86b3-595167a310fd None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:33.243686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-907cd01f-31e4-4fe2-86b3-595167a310fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:33.268277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 842/1715] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:33.268277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb5b97-aebb-403e-809b-fd39901c479b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.268277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb5b97-aebb-403e-809b-fd39901c479b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.268277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb5b97-aebb-403e-809b-fd39901c479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.322290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fdfb5b97-aebb-403e-809b-fd39901c479b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:33.323550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fdfb5b97-aebb-403e-809b-fd39901c479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:33.379577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 874/1716] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:33.380874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd01f-31e4-4fe2-86b3-595167a310fd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:33.391501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd01f-31e4-4fe2-86b3-595167a310fd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:33.400110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fc5d0-0040-4952-a34c-a15896c14343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:33.406911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc5d0-0040-4952-a34c-a15896c14343 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.409931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc5d0-0040-4952-a34c-a15896c14343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.410302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc5d0-0040-4952-a34c-a15896c14343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.410998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fc5d0-0040-4952-a34c-a15896c14343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:33.413283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fc5d0-0040-4952-a34c-a15896c14343 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:33.463407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 875/1717] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:33.463407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fc5d0-0040-4952-a34c-a15896c14343 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:33.464301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb0fc5d0-0040-4952-a34c-a15896c14343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:33.476489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 843/1718] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:33.477602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64f94-6af5-4fc8-b39c-67ae0b16b067 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.477888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64f94-6af5-4fc8-b39c-67ae0b16b067 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.478192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e64f94-6af5-4fc8-b39c-67ae0b16b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.555132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-49e64f94-6af5-4fc8-b39c-67ae0b16b067 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:33.556369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-49e64f94-6af5-4fc8-b39c-67ae0b16b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:33.590485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 844/1719] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:33.591514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64f94-6af5-4fc8-b39c-67ae0b16b067 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:33.605638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e64f94-6af5-4fc8-b39c-67ae0b16b067 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:33.612976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cfe79-e7a5-413b-a5dd-3a4727a2854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:33.613906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cfe79-e7a5-413b-a5dd-3a4727a2854e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.614264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cfe79-e7a5-413b-a5dd-3a4727a2854e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.614545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cfe79-e7a5-413b-a5dd-3a4727a2854e admin admin] PATH_INFO: `/v3/projects/60218ed50e3940cc9f9fab879d464947/users/f66399558aa74a8c968c72639f1aef3f/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.633961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fc5d0-0040-4952-a34c-a15896c14343 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:33.642756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e545359-1369-46a4-84e1-6cf9991b68d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:33.643492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e545359-1369-46a4-84e1-6cf9991b68d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.643856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e545359-1369-46a4-84e1-6cf9991b68d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.644233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e545359-1369-46a4-84e1-6cf9991b68d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.655831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e545359-1369-46a4-84e1-6cf9991b68d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:33.657498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e545359-1369-46a4-84e1-6cf9991b68d0 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:33.658947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cfe79-e7a5-413b-a5dd-3a4727a2854e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60218ed50e3940cc9f9fab879d464947, user_id=f66399558aa74a8c968c72639f1aef3f, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:33.662359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cfe79-e7a5-413b-a5dd-3a4727a2854e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:33.671112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 876/1720] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:33.672011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e545359-1369-46a4-84e1-6cf9991b68d0 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:33.673847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1e545359-1369-46a4-84e1-6cf9991b68d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:33.774832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e545359-1369-46a4-84e1-6cf9991b68d0 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:33.780698 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98d48-a6c1-4847-8f4f-ac1a300386a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:33.781594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98d48-a6c1-4847-8f4f-ac1a300386a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.781790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98d48-a6c1-4847-8f4f-ac1a300386a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.786248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98d48-a6c1-4847-8f4f-ac1a300386a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.804182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 845/1721] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:33 2022] PUT /identity/v3/projects/60218ed50e3940cc9f9fab879d464947/users/f66399558aa74a8c968c72639f1aef3f/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:33.805446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cfe79-e7a5-413b-a5dd-3a4727a2854e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:33.811902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde98d48-a6c1-4847-8f4f-ac1a300386a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:33.813502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde98d48-a6c1-4847-8f4f-ac1a300386a0 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:33.821537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:33.847109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 877/1722] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:33.848276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47b195-f817-4f3e-a87b-ed98741274c8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.848567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47b195-f817-4f3e-a87b-ed98741274c8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.848839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47b195-f817-4f3e-a87b-ed98741274c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.949033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cfe79-e7a5-413b-a5dd-3a4727a2854e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:33.958686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0b47b195-f817-4f3e-a87b-ed98741274c8 None None] MFA Rules not processed for user `f66399558aa74a8c968c72639f1aef3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:33.959462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a215e-35a1-4e7b-a1b6-3527a3da3116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:33.959781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a215e-35a1-4e7b-a1b6-3527a3da3116 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:33.960192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a215e-35a1-4e7b-a1b6-3527a3da3116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:33.960422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b47b195-f817-4f3e-a87b-ed98741274c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:33.960653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a215e-35a1-4e7b-a1b6-3527a3da3116 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:33.961450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a215e-35a1-4e7b-a1b6-3527a3da3116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:33.961875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a215e-35a1-4e7b-a1b6-3527a3da3116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:33.963721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a215e-35a1-4e7b-a1b6-3527a3da3116 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:33.991533 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 846/1723] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:33.995688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a215e-35a1-4e7b-a1b6-3527a3da3116 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:34.024607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a215e-35a1-4e7b-a1b6-3527a3da3116 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:34.054040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b34e2-72c5-4c29-945e-0d2f630e5917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:34.056440 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b34e2-72c5-4c29-945e-0d2f630e5917 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:34.056837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b34e2-72c5-4c29-945e-0d2f630e5917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:34.057224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b34e2-72c5-4c29-945e-0d2f630e5917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:34.084395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b34e2-72c5-4c29-945e-0d2f630e5917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:34.086790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b34e2-72c5-4c29-945e-0d2f630e5917 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:34.209685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 878/1724] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:34.209685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47b195-f817-4f3e-a87b-ed98741274c8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:34.286798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 847/1725] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:33 2022] POST /identity/v3/projects => generated 357 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:34.288138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b34e2-72c5-4c29-945e-0d2f630e5917 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:34.407194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47b195-f817-4f3e-a87b-ed98741274c8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:34.447378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b34e2-72c5-4c29-945e-0d2f630e5917 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:34.462888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f6678-cc93-407e-afc7-e2f48f80a68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:34.463764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6678-cc93-407e-afc7-e2f48f80a68d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:34.464225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6678-cc93-407e-afc7-e2f48f80a68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:34.464790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6678-cc93-407e-afc7-e2f48f80a68d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:34.466598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f6678-cc93-407e-afc7-e2f48f80a68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:34.468964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f6678-cc93-407e-afc7-e2f48f80a68d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:34.601950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 848/1726] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:34 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:34.603356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f6678-cc93-407e-afc7-e2f48f80a68d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:34.622632 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8d2b-c36b-46aa-91ec-3c4938d91d95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:34.623547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8d2b-c36b-46aa-91ec-3c4938d91d95 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:34.623844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8d2b-c36b-46aa-91ec-3c4938d91d95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:34.624127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8d2b-c36b-46aa-91ec-3c4938d91d95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:34.638122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-13fa8d2b-c36b-46aa-91ec-3c4938d91d95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:34.720967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:34.746114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa8d2b-c36b-46aa-91ec-3c4938d91d95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:34.748119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa8d2b-c36b-46aa-91ec-3c4938d91d95 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:34.783782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 879/1727] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:34.784935 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8d2b-c36b-46aa-91ec-3c4938d91d95 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:34.798633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8d2b-c36b-46aa-91ec-3c4938d91d95 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:34.942610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f6678-cc93-407e-afc7-e2f48f80a68d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:34.957319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc153ae-ccea-4032-9529-a29a5403cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:34.958001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc153ae-ccea-4032-9529-a29a5403cac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:34.962337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc153ae-ccea-4032-9529-a29a5403cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:34.963097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc153ae-ccea-4032-9529-a29a5403cac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:34.964920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc153ae-ccea-4032-9529-a29a5403cac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:34.968493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc153ae-ccea-4032-9529-a29a5403cac3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:34.991960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78679929-33d8-4bea-9894-015667a354ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:34.992610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78679929-33d8-4bea-9894-015667a354ad admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:34.992978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78679929-33d8-4bea-9894-015667a354ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:34.993418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78679929-33d8-4bea-9894-015667a354ad admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:34.994156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78679929-33d8-4bea-9894-015667a354ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:34.997578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78679929-33d8-4bea-9894-015667a354ad admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.013294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:35.060444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 849/1728] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:34 2022] POST /identity/v3/users => generated 279 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:35.067243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc153ae-ccea-4032-9529-a29a5403cac3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:35.107467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc153ae-ccea-4032-9529-a29a5403cac3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:35.120303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 880/1729] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:34 2022] POST /identity/v3/users => generated 300 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:35.121383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78679929-33d8-4bea-9894-015667a354ad admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:35.124171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e004297-382b-4d54-8940-cef23119a0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:35.124631 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e004297-382b-4d54-8940-cef23119a0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.129536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e004297-382b-4d54-8940-cef23119a0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.129862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e004297-382b-4d54-8940-cef23119a0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.130728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e004297-382b-4d54-8940-cef23119a0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:35.133127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e004297-382b-4d54-8940-cef23119a0c2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.151447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 850/1730] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:35.152906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e004297-382b-4d54-8940-cef23119a0c2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:35.157987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78679929-33d8-4bea-9894-015667a354ad admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:35.168954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff94872-e67b-4f65-bedf-4a8ec544c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:35.169679 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94872-e67b-4f65-bedf-4a8ec544c8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.170107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94872-e67b-4f65-bedf-4a8ec544c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.170562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94872-e67b-4f65-bedf-4a8ec544c8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.171297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff94872-e67b-4f65-bedf-4a8ec544c8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:35.173505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff94872-e67b-4f65-bedf-4a8ec544c8b5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.191664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 881/1731] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:01:35.192840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff94872-e67b-4f65-bedf-4a8ec544c8b5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:35.193662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e004297-382b-4d54-8940-cef23119a0c2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:35.195312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aff94872-e67b-4f65-bedf-4a8ec544c8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:35.207892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c38b7-426f-4abc-a734-947db6df2a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:35.208543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c38b7-426f-4abc-a734-947db6df2a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.208829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c38b7-426f-4abc-a734-947db6df2a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.209106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c38b7-426f-4abc-a734-947db6df2a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.209774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c38b7-426f-4abc-a734-947db6df2a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:35.211464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c38b7-426f-4abc-a734-947db6df2a62 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.213581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff94872-e67b-4f65-bedf-4a8ec544c8b5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:35.219625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:35.220356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.220725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.221108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] PATH_INFO: `/v3/projects/ce348820fd49431480cccf45a540e91f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.231993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce348820fd49431480cccf45a540e91f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:35.235191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.239467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 851/1732] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:35.239467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c38b7-426f-4abc-a734-947db6df2a62 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:35.262250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c38b7-426f-4abc-a734-947db6df2a62 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:35.288318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a7ba9-6b3f-4631-87c0-c29ee819314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:35.289018 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7ba9-6b3f-4631-87c0-c29ee819314b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.289293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7ba9-6b3f-4631-87c0-c29ee819314b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.289571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7ba9-6b3f-4631-87c0-c29ee819314b admin admin] PATH_INFO: `/v3/projects/cba69e790c8d47f883b728529d6bfd35/users/245ca3e8ddbb4add983bb2f237486a80/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.323421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a7ba9-6b3f-4631-87c0-c29ee819314b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba69e790c8d47f883b728529d6bfd35, user_id=245ca3e8ddbb4add983bb2f237486a80, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:35.326310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a7ba9-6b3f-4631-87c0-c29ee819314b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.453887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 852/1733] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:35 2022] PUT /identity/v3/projects/cba69e790c8d47f883b728529d6bfd35/users/245ca3e8ddbb4add983bb2f237486a80/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:35.454942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a7ba9-6b3f-4631-87c0-c29ee819314b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:35.491837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce348820fd49431480cccf45a540e91f', 'request_id': 'req-d6698f9d-f444-4422-84ee-ac25a2b49185'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:35.499717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce348820fd49431480cccf45a540e91f', 'request_id': 'req-d6698f9d-f444-4422-84ee-ac25a2b49185'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:35.532782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a7ba9-6b3f-4631-87c0-c29ee819314b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:35.589821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abcb9b-41c6-4559-897d-52fdcf867f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:35.590533 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abcb9b-41c6-4559-897d-52fdcf867f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.590818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abcb9b-41c6-4559-897d-52fdcf867f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.591094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abcb9b-41c6-4559-897d-52fdcf867f11 admin admin] PATH_INFO: `/v3/projects/f446c263a5224491a97620b575083228/users/ffe0360cefb74802ad50abd002b654df/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.600427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce348820fd49431480cccf45a540e91f', 'request_id': 'req-d6698f9d-f444-4422-84ee-ac25a2b49185'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:35.612298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abcb9b-41c6-4559-897d-52fdcf867f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f446c263a5224491a97620b575083228, user_id=ffe0360cefb74802ad50abd002b654df, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:35.615610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abcb9b-41c6-4559-897d-52fdcf867f11 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.616444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] The token cache is being invalidate because project ce348820fd49431480cccf45a540e91f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:35.616883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:35.617697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:35.620468 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 882/1734] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:35 2022] DELETE /identity/v3/projects/ce348820fd49431480cccf45a540e91f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:35.624568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:35.626306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:35.658948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698f9d-f444-4422-84ee-ac25a2b49185 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:35.670370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff7924-8301-4ff8-94c9-183576ab717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:35.672199 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7924-8301-4ff8-94c9-183576ab717f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.672818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7924-8301-4ff8-94c9-183576ab717f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.673566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7924-8301-4ff8-94c9-183576ab717f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.675836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff7924-8301-4ff8-94c9-183576ab717f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:35.677912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff7924-8301-4ff8-94c9-183576ab717f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.693264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 883/1735] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:35.695023 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c791a-39ac-4141-87b4-b8b70a530460 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.695320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c791a-39ac-4141-87b4-b8b70a530460 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.695789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c791a-39ac-4141-87b4-b8b70a530460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.700011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 853/1736] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:35 2022] PUT /identity/v3/projects/f446c263a5224491a97620b575083228/users/ffe0360cefb74802ad50abd002b654df/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:35.701092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abcb9b-41c6-4559-897d-52fdcf867f11 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:35.704641 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30abcb9b-41c6-4559-897d-52fdcf867f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:35.732798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-037c791a-39ac-4141-87b4-b8b70a530460 None None] MFA Rules not processed for user `25274e19c10c4e8fb35b37f06e6bfdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:35.734681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-037c791a-39ac-4141-87b4-b8b70a530460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:35.819412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 884/1737] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:35.820759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c791a-39ac-4141-87b4-b8b70a530460 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:35.827930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abcb9b-41c6-4559-897d-52fdcf867f11 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:35.862965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c791a-39ac-4141-87b4-b8b70a530460 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:35.882879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ad503-9009-4bd8-ab2f-08d9141802f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:35.883575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ad503-9009-4bd8-ab2f-08d9141802f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.883853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ad503-9009-4bd8-ab2f-08d9141802f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.884134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ad503-9009-4bd8-ab2f-08d9141802f0 admin admin] PATH_INFO: `/v3/projects/cba69e790c8d47f883b728529d6bfd35/users/245ca3e8ddbb4add983bb2f237486a80/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.886554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ad503-9009-4bd8-ab2f-08d9141802f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba69e790c8d47f883b728529d6bfd35, user_id=245ca3e8ddbb4add983bb2f237486a80, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:35.890425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ad503-9009-4bd8-ab2f-08d9141802f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.897939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:35.902320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:35.907843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.907843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.907843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] PATH_INFO: `/v3/users/2c4353dd11b64d5fb64bd84ff562918b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.908936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 885/1738] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:35 2022] PUT /identity/v3/projects/cba69e790c8d47f883b728529d6bfd35/users/245ca3e8ddbb4add983bb2f237486a80/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:35.910270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf93bc0-7c5c-4c88-ad24-5644db7651e2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:35.910555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf93bc0-7c5c-4c88-ad24-5644db7651e2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:35.910834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf93bc0-7c5c-4c88-ad24-5644db7651e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:35.912292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4353dd11b64d5fb64bd84ff562918b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:35.914363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:35.955430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4cf93bc0-7c5c-4c88-ad24-5644db7651e2 None None] MFA Rules not processed for user `ffe0360cefb74802ad50abd002b654df`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:35.956757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4cf93bc0-7c5c-4c88-ad24-5644db7651e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:36.079820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 886/1739] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:36.087858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87dbc0-426d-4689-8f4b-8274f054f4d8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:36.099195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87dbc0-426d-4689-8f4b-8274f054f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:36.101010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87dbc0-426d-4689-8f4b-8274f054f4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:36.144762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4353dd11b64d5fb64bd84ff562918b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:36.146292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4353dd11b64d5fb64bd84ff562918b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:36.170168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4353dd11b64d5fb64bd84ff562918b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:36.171079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4353dd11b64d5fb64bd84ff562918b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:36.193193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8a87dbc0-426d-4689-8f4b-8274f054f4d8 None None] MFA Rules not processed for user `245ca3e8ddbb4add983bb2f237486a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:36.193193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8a87dbc0-426d-4689-8f4b-8274f054f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:36.202789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4353dd11b64d5fb64bd84ff562918b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:36.280512 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 854/1740] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:35 2022] DELETE /identity/v3/users/2c4353dd11b64d5fb64bd84ff562918b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:36.283086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:36.290626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:36.326907 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 887/1741] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:36.349049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87dbc0-426d-4689-8f4b-8274f054f4d8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:36.351690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8a87dbc0-426d-4689-8f4b-8274f054f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:36.391074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:36.435469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944988b-9b67-4cd1-b254-11c50872749c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:36.442316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2befeb0-ed0c-4392-8db4-29760c8cee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:36.443072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befeb0-ed0c-4392-8db4-29760c8cee35 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:36.443280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befeb0-ed0c-4392-8db4-29760c8cee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:36.443571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befeb0-ed0c-4392-8db4-29760c8cee35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:36.444221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2befeb0-ed0c-4392-8db4-29760c8cee35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:36.448395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2befeb0-ed0c-4392-8db4-29760c8cee35 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:36.511573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87dbc0-426d-4689-8f4b-8274f054f4d8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:36.563103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 855/1742] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:36 2022] POST /identity/v3/projects => generated 355 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:36.563103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe33c-2786-41c8-a825-45e280813809 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:36.563103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe33c-2786-41c8-a825-45e280813809 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:36.565112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe33c-2786-41c8-a825-45e280813809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:36.620828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9991c1a-5cf4-459c-b11d-e05c691ea6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:36.621456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9991c1a-5cf4-459c-b11d-e05c691ea6da service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:36.621781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9991c1a-5cf4-459c-b11d-e05c691ea6da service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:36.622582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9991c1a-5cf4-459c-b11d-e05c691ea6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:36.730727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9e0fe33c-2786-41c8-a825-45e280813809 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:36.733985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9e0fe33c-2786-41c8-a825-45e280813809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:36.777937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9991c1a-5cf4-459c-b11d-e05c691ea6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:36.779651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9991c1a-5cf4-459c-b11d-e05c691ea6da service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:36.811127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 888/1743] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:36.811127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9991c1a-5cf4-459c-b11d-e05c691ea6da service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:36.826473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9991c1a-5cf4-459c-b11d-e05c691ea6da service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:36.942277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 856/1744] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:01:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:37.005469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10afea2-4694-46a1-b2d1-b55fbc397bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:37.006237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10afea2-4694-46a1-b2d1-b55fbc397bee admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:37.006423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10afea2-4694-46a1-b2d1-b55fbc397bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:37.006747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10afea2-4694-46a1-b2d1-b55fbc397bee admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:37.007397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10afea2-4694-46a1-b2d1-b55fbc397bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:37.010410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10afea2-4694-46a1-b2d1-b55fbc397bee admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:37.041797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fe33c-2786-41c8-a825-45e280813809 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:37.043718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9e0fe33c-2786-41c8-a825-45e280813809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:37.070899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fe33c-2786-41c8-a825-45e280813809 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:37.076864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:37.077523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:37.077813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:37.078480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] PATH_INFO: `/v3/users/f66399558aa74a8c968c72639f1aef3f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:37.079295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66399558aa74a8c968c72639f1aef3f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:37.081311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:37.148994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 889/1745] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:36 2022] POST /identity/v3/users => generated 284 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:37.157420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10afea2-4694-46a1-b2d1-b55fbc397bee admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:37.246301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10afea2-4694-46a1-b2d1-b55fbc397bee admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:37.254273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733e514-9cdb-46b0-857d-7959cbe6f254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:37.254899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733e514-9cdb-46b0-857d-7959cbe6f254 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:37.255181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733e514-9cdb-46b0-857d-7959cbe6f254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:37.256369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733e514-9cdb-46b0-857d-7959cbe6f254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:37.257239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733e514-9cdb-46b0-857d-7959cbe6f254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:37.265122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733e514-9cdb-46b0-857d-7959cbe6f254 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:37.282480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 890/1746] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:37.300819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733e514-9cdb-46b0-857d-7959cbe6f254 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:37.327273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733e514-9cdb-46b0-857d-7959cbe6f254 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:37.342397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de5db7-45d5-4733-8c9f-b66a97a6be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:37.342397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de5db7-45d5-4733-8c9f-b66a97a6be30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:37.342581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de5db7-45d5-4733-8c9f-b66a97a6be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:37.362285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de5db7-45d5-4733-8c9f-b66a97a6be30 admin admin] PATH_INFO: `/v3/projects/fe778bb779ae4a05a3ef15a18af69b11/users/9bc0bfb93f714cd88f445227c2881331/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:37.429719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de5db7-45d5-4733-8c9f-b66a97a6be30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe778bb779ae4a05a3ef15a18af69b11, user_id=9bc0bfb93f714cd88f445227c2881331, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:37.434791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de5db7-45d5-4733-8c9f-b66a97a6be30 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:37.458381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66399558aa74a8c968c72639f1aef3f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:37.462221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66399558aa74a8c968c72639f1aef3f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:37.496557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66399558aa74a8c968c72639f1aef3f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:37.501163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66399558aa74a8c968c72639f1aef3f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:37.522527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66399558aa74a8c968c72639f1aef3f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:37.572734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 891/1747] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:37 2022] PUT /identity/v3/projects/fe778bb779ae4a05a3ef15a18af69b11/users/9bc0bfb93f714cd88f445227c2881331/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:37.573930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de5db7-45d5-4733-8c9f-b66a97a6be30 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:37.578457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-10de5db7-45d5-4733-8c9f-b66a97a6be30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:37.631162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:37.643497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 857/1748] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:37 2022] DELETE /identity/v3/users/f66399558aa74a8c968c72639f1aef3f => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:01:37.644554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:37.646280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:37.803585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c2802-d6c4-4fa3-92c2-645dcd80631c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:37.810785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:37.811496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:37.811779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:37.811939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de5db7-45d5-4733-8c9f-b66a97a6be30 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:37.812414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] PATH_INFO: `/v3/projects/a31678019b5a4d47958b6c66c555267c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:37.813538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31678019b5a4d47958b6c66c555267c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:37.816584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:37.930537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:37.931171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:37.931709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:37.932004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:37.933848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:37.999949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31678019b5a4d47958b6c66c555267c', 'request_id': 'req-84f3f331-443d-457b-91ad-fa2e0da400b5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:38.012508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31678019b5a4d47958b6c66c555267c', 'request_id': 'req-84f3f331-443d-457b-91ad-fa2e0da400b5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:38.027936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31678019b5a4d47958b6c66c555267c', 'request_id': 'req-84f3f331-443d-457b-91ad-fa2e0da400b5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:38.057011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:38.058790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:38.073518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 892/1749] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:01:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:01:38.076197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:38.077187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:38.101841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] The token cache is being invalidate because project a31678019b5a4d47958b6c66c555267c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:38.101841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:38.101841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-84f3f331-443d-457b-91ad-fa2e0da400b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:38.108162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 858/1750] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:37 2022] DELETE /identity/v3/projects/a31678019b5a4d47958b6c66c555267c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:38.109386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8d39e-a5ad-4cc9-bf83-3027966893df service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:38.109702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9033ee-e0a6-40cd-8df4-7cfab57f69ff None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:38.109995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9033ee-e0a6-40cd-8df4-7cfab57f69ff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:38.110410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9033ee-e0a6-40cd-8df4-7cfab57f69ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:38.139930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:38.177327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6f9033ee-e0a6-40cd-8df4-7cfab57f69ff None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:38.186554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6f9033ee-e0a6-40cd-8df4-7cfab57f69ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:38.288196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074b692-0a21-4931-9102-572e1642c047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:38.288963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074b692-0a21-4931-9102-572e1642c047 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:38.289295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074b692-0a21-4931-9102-572e1642c047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:38.289708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074b692-0a21-4931-9102-572e1642c047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:38.290446 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074b692-0a21-4931-9102-572e1642c047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:38.292407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074b692-0a21-4931-9102-572e1642c047 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:38.315222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 893/1751] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:38.319333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5340f-07bc-436d-aeb6-806efb2516ba None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:38.319844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5340f-07bc-436d-aeb6-806efb2516ba None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:38.320317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5340f-07bc-436d-aeb6-806efb2516ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:38.388569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 859/1752] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:38.396644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c521d5-0593-413b-b99c-8768186f30a1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:38.402066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c521d5-0593-413b-b99c-8768186f30a1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:38.402389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c521d5-0593-413b-b99c-8768186f30a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:38.406066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-36a5340f-07bc-436d-aeb6-806efb2516ba None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:38.409329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-36a5340f-07bc-436d-aeb6-806efb2516ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:38.452671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 894/1753] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:38.453648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5340f-07bc-436d-aeb6-806efb2516ba None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:38.462509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-36a5340f-07bc-436d-aeb6-806efb2516ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:38.479392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-83c521d5-0593-413b-b99c-8768186f30a1 None None] MFA Rules not processed for user `e0b66989d4df4398ad723f587cbc24bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:38.480665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-83c521d5-0593-413b-b99c-8768186f30a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:38.499819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5340f-07bc-436d-aeb6-806efb2516ba None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:38.516811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c79a9-76cc-42cd-b1a2-4c65d4b7026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:38.517587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c79a9-76cc-42cd-b1a2-4c65d4b7026d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:38.517873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c79a9-76cc-42cd-b1a2-4c65d4b7026d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:38.518157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c79a9-76cc-42cd-b1a2-4c65d4b7026d admin admin] PATH_INFO: `/v3/projects/fe778bb779ae4a05a3ef15a18af69b11/users/9bc0bfb93f714cd88f445227c2881331/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:38.537851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c79a9-76cc-42cd-b1a2-4c65d4b7026d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe778bb779ae4a05a3ef15a18af69b11, user_id=9bc0bfb93f714cd88f445227c2881331, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:38.540936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c79a9-76cc-42cd-b1a2-4c65d4b7026d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:38.603982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 895/1754] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:38 2022] PUT /identity/v3/projects/fe778bb779ae4a05a3ef15a18af69b11/users/9bc0bfb93f714cd88f445227c2881331/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:38.605644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cfb2e-8a4e-45d5-9cb3-2527459c3e6b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:38.606301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cfb2e-8a4e-45d5-9cb3-2527459c3e6b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:38.609289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cfb2e-8a4e-45d5-9cb3-2527459c3e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:38.664198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:38.671857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-723cfb2e-8a4e-45d5-9cb3-2527459c3e6b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:38.678175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-723cfb2e-8a4e-45d5-9cb3-2527459c3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:38.712546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 860/1755] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Oct 4 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:38.733383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c521d5-0593-413b-b99c-8768186f30a1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:38.743677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-83c521d5-0593-413b-b99c-8768186f30a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:38.755175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:38.770845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c521d5-0593-413b-b99c-8768186f30a1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:38.892782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 896/1756] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:38.897908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73dea2-f244-4b5a-9d55-79e51c246f3d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:38.899176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73dea2-f244-4b5a-9d55-79e51c246f3d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:38.899412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73dea2-f244-4b5a-9d55-79e51c246f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:39.023202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe1e4d-39a3-4477-9e58-4c5c505468aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:39.023944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe1e4d-39a3-4477-9e58-4c5c505468aa service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:39.024321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe1e4d-39a3-4477-9e58-4c5c505468aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:39.027615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe1e4d-39a3-4477-9e58-4c5c505468aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:39.040475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bd73dea2-f244-4b5a-9d55-79e51c246f3d None None] MFA Rules not processed for user `9bc0bfb93f714cd88f445227c2881331`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:39.053578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bd73dea2-f244-4b5a-9d55-79e51c246f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:39.056588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe1e4d-39a3-4477-9e58-4c5c505468aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:39.073111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe1e4d-39a3-4477-9e58-4c5c505468aa service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:39.115746 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 861/1757] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:39.116952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe1e4d-39a3-4477-9e58-4c5c505468aa service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:39.139056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:39.165175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe1e4d-39a3-4477-9e58-4c5c505468aa service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:39.175151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:39.175151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:39.175151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:39.175151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:39.176381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:39.176803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:39.181071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:39.203472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 862/1758] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:39.203472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:39.226274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:39.253834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ced0e1-155f-4e61-94db-35c8cd550d90 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:39.257785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee586a4-a802-41cf-85b5-6516cfdd4397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:39.258826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee586a4-a802-41cf-85b5-6516cfdd4397 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:39.259686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee586a4-a802-41cf-85b5-6516cfdd4397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:39.259976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee586a4-a802-41cf-85b5-6516cfdd4397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:39.268077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee586a4-a802-41cf-85b5-6516cfdd4397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:39.270772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee586a4-a802-41cf-85b5-6516cfdd4397 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:39.280214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 897/1759] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:39.281306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73dea2-f244-4b5a-9d55-79e51c246f3d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:39.313118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73dea2-f244-4b5a-9d55-79e51c246f3d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:39.325813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 863/1760] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:39.327519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee586a4-a802-41cf-85b5-6516cfdd4397 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:39.349095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c226c34-7e97-45c4-b866-ed4f5f63b099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:39.349600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c226c34-7e97-45c4-b866-ed4f5f63b099 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:39.349885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c226c34-7e97-45c4-b866-ed4f5f63b099 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:39.350218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c226c34-7e97-45c4-b866-ed4f5f63b099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:39.359147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c226c34-7e97-45c4-b866-ed4f5f63b099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:39.360881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c226c34-7e97-45c4-b866-ed4f5f63b099 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:39.365394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee586a4-a802-41cf-85b5-6516cfdd4397 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:39.380178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7ddc8-d2b7-4a42-9b3f-738da03b33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:39.380817 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7ddc8-d2b7-4a42-9b3f-738da03b33ba admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:39.381109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7ddc8-d2b7-4a42-9b3f-738da03b33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:39.381394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7ddc8-d2b7-4a42-9b3f-738da03b33ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:39.382049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7ddc8-d2b7-4a42-9b3f-738da03b33ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:39.384205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7ddc8-d2b7-4a42-9b3f-738da03b33ba admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:39.393557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 898/1761] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:39.394453 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c226c34-7e97-45c4-b866-ed4f5f63b099 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:39.396941 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2c226c34-7e97-45c4-b866-ed4f5f63b099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:39.559347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 864/1762] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:39 2022] POST /identity/v3/projects => generated 365 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:39.561142 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7ddc8-d2b7-4a42-9b3f-738da03b33ba admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:39.605800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c226c34-7e97-45c4-b866-ed4f5f63b099 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:39.861594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec1f9f-2d05-41e5-940a-eef7b0fad187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:39.861594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec1f9f-2d05-41e5-940a-eef7b0fad187 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:39.861594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec1f9f-2d05-41e5-940a-eef7b0fad187 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:39.861594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec1f9f-2d05-41e5-940a-eef7b0fad187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:39.862461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7ddc8-d2b7-4a42-9b3f-738da03b33ba admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:39.862461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff426ce-1835-49b5-a555-5929dc5bb15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:39.862461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff426ce-1835-49b5-a555-5929dc5bb15b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:39.862461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff426ce-1835-49b5-a555-5929dc5bb15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:39.862992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff426ce-1835-49b5-a555-5929dc5bb15b admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:39.862992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff426ce-1835-49b5-a555-5929dc5bb15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:39.862992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff426ce-1835-49b5-a555-5929dc5bb15b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:39.863445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec1f9f-2d05-41e5-940a-eef7b0fad187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:39.863445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec1f9f-2d05-41e5-940a-eef7b0fad187 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:39.863445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 899/1763] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:40.227067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 865/1764] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:39 2022] POST /identity/v3/users => generated 283 bytes in 666 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:40.231586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:40.231698 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec1f9f-2d05-41e5-940a-eef7b0fad187 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:40.256561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec1f9f-2d05-41e5-940a-eef7b0fad187 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:40.265425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6c2b8-f078-47c8-ae2a-1ed64af1ed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:40.267886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6c2b8-f078-47c8-ae2a-1ed64af1ed09 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:40.267886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6c2b8-f078-47c8-ae2a-1ed64af1ed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:40.268373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6c2b8-f078-47c8-ae2a-1ed64af1ed09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:40.269299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6c2b8-f078-47c8-ae2a-1ed64af1ed09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:40.272443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6c2b8-f078-47c8-ae2a-1ed64af1ed09 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:40.293552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 900/1765] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:40.295015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff426ce-1835-49b5-a555-5929dc5bb15b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:40.301896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6c2b8-f078-47c8-ae2a-1ed64af1ed09 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:40.307891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2ad6c2b8-f078-47c8-ae2a-1ed64af1ed09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:40.314469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff426ce-1835-49b5-a555-5929dc5bb15b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:40.320538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11472dc6-c65a-493d-9504-aa55d49a682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:40.321298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11472dc6-c65a-493d-9504-aa55d49a682a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:40.321674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11472dc6-c65a-493d-9504-aa55d49a682a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:40.322413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11472dc6-c65a-493d-9504-aa55d49a682a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:40.323230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11472dc6-c65a-493d-9504-aa55d49a682a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:40.325161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11472dc6-c65a-493d-9504-aa55d49a682a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:40.356685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6c2b8-f078-47c8-ae2a-1ed64af1ed09 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:40.358724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 866/1766] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:40.361596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11472dc6-c65a-493d-9504-aa55d49a682a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:40.372383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:40.373148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:40.374968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:40.375266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] PATH_INFO: `/v3/users/c4a7739dd7df42839fe5703515883e95` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:40.381563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a7739dd7df42839fe5703515883e95)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:40.386988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:40.389957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11472dc6-c65a-493d-9504-aa55d49a682a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:40.405017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb156545-ff0f-43b3-a066-c2fbf58e3135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:40.409777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb156545-ff0f-43b3-a066-c2fbf58e3135 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:40.409777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb156545-ff0f-43b3-a066-c2fbf58e3135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:40.409777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb156545-ff0f-43b3-a066-c2fbf58e3135 admin admin] PATH_INFO: `/v3/projects/14111257264f42b5a564bb18c9911fdb/users/bcbb590088224c19b2a4a3869be8e560/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:40.438813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb156545-ff0f-43b3-a066-c2fbf58e3135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14111257264f42b5a564bb18c9911fdb, user_id=bcbb590088224c19b2a4a3869be8e560, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:40.449918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb156545-ff0f-43b3-a066-c2fbf58e3135 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:40.589566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 867/1767] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:40 2022] PUT /identity/v3/projects/14111257264f42b5a564bb18c9911fdb/users/bcbb590088224c19b2a4a3869be8e560/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:01:40.589566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb156545-ff0f-43b3-a066-c2fbf58e3135 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:40.593628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cb156545-ff0f-43b3-a066-c2fbf58e3135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:40.719151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a7739dd7df42839fe5703515883e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:40.722633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a7739dd7df42839fe5703515883e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:40.757360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a7739dd7df42839fe5703515883e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:40.790576 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb156545-ff0f-43b3-a066-c2fbf58e3135 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:40.796428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:40.797135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:40.797805 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:40.798140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] PATH_INFO: `/v3/projects/60218ed50e3940cc9f9fab879d464947` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:40.800707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] RBAC: Authorizing `identity:delete_project(project_id=60218ed50e3940cc9f9fab879d464947)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:40.804206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:40.828304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a7739dd7df42839fe5703515883e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:40.830474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a7739dd7df42839fe5703515883e95'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:40.886680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 901/1768] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:40 2022] DELETE /identity/v3/users/c4a7739dd7df42839fe5703515883e95 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:40.887871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:40.889601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:40.982300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163b65-09c0-4ded-b6f8-40eb2a0cf921 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:41.014555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60218ed50e3940cc9f9fab879d464947', 'request_id': 'req-3705093b-bb89-4b66-81bf-efe34a16839e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:41.034898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60218ed50e3940cc9f9fab879d464947', 'request_id': 'req-3705093b-bb89-4b66-81bf-efe34a16839e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:41.053230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60218ed50e3940cc9f9fab879d464947', 'request_id': 'req-3705093b-bb89-4b66-81bf-efe34a16839e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:41.067949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:41.102636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fce5a2-a5d1-4017-b2d5-dbc2003bc39f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:41.103573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fce5a2-a5d1-4017-b2d5-dbc2003bc39f service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:41.107360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fce5a2-a5d1-4017-b2d5-dbc2003bc39f service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:41.107360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fce5a2-a5d1-4017-b2d5-dbc2003bc39f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:41.107778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-76fce5a2-a5d1-4017-b2d5-dbc2003bc39f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:41.175842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] The token cache is being invalidate because project 60218ed50e3940cc9f9fab879d464947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:41.176135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:41.176802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3705093b-bb89-4b66-81bf-efe34a16839e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:41.178586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 868/1769] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:40 2022] DELETE /identity/v3/projects/60218ed50e3940cc9f9fab879d464947 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:41.182738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300e18c-94a7-4f69-92a5-120da9556c4e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:41.183024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300e18c-94a7-4f69-92a5-120da9556c4e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:41.183295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300e18c-94a7-4f69-92a5-120da9556c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:41.269511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fce5a2-a5d1-4017-b2d5-dbc2003bc39f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:41.271567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fce5a2-a5d1-4017-b2d5-dbc2003bc39f service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:41.293794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 902/1770] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:41.296532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd63cd-ef1a-473d-a899-cbdcc358c14b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:41.296826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd63cd-ef1a-473d-a899-cbdcc358c14b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:41.297116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd63cd-ef1a-473d-a899-cbdcc358c14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:41.311155 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0300e18c-94a7-4f69-92a5-120da9556c4e None None] MFA Rules not processed for user `bcbb590088224c19b2a4a3869be8e560`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:41.314386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0300e18c-94a7-4f69-92a5-120da9556c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:41.341780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-87dd63cd-ef1a-473d-a899-cbdcc358c14b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:41.358385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-87dd63cd-ef1a-473d-a899-cbdcc358c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:41.474695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 869/1771] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:41.475706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300e18c-94a7-4f69-92a5-120da9556c4e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:41.476929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0300e18c-94a7-4f69-92a5-120da9556c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:41.523913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:41.565102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 903/1772] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:41.565102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd63cd-ef1a-473d-a899-cbdcc358c14b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:41.565102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-87dd63cd-ef1a-473d-a899-cbdcc358c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:41.583059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd63cd-ef1a-473d-a899-cbdcc358c14b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:41.590517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8848b-b45b-41d2-8ea2-dc4df2f3ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:41.591196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8848b-b45b-41d2-8ea2-dc4df2f3ebab admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:41.591942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8848b-b45b-41d2-8ea2-dc4df2f3ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:41.591942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8848b-b45b-41d2-8ea2-dc4df2f3ebab admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:41.592504 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8848b-b45b-41d2-8ea2-dc4df2f3ebab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:41.594594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8848b-b45b-41d2-8ea2-dc4df2f3ebab admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:41.604834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300e18c-94a7-4f69-92a5-120da9556c4e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:41.618108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:41.620863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:41.622137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:41.622137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] PATH_INFO: `/v3/users/245ca3e8ddbb4add983bb2f237486a80` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:41.625703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=245ca3e8ddbb4add983bb2f237486a80)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:41.630957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:41.740718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 904/1773] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:41 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:41.740718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8848b-b45b-41d2-8ea2-dc4df2f3ebab admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:41.740718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-86b8848b-b45b-41d2-8ea2-dc4df2f3ebab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:41.901061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8848b-b45b-41d2-8ea2-dc4df2f3ebab admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:41.904251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245ca3e8ddbb4add983bb2f237486a80'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:41.906237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245ca3e8ddbb4add983bb2f237486a80'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:41.910611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ecbd1-e339-4594-98ff-67b55cb8c23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:41.911388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ecbd1-e339-4594-98ff-67b55cb8c23e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:41.912180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ecbd1-e339-4594-98ff-67b55cb8c23e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:41.913996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ecbd1-e339-4594-98ff-67b55cb8c23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:41.928025 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245ca3e8ddbb4add983bb2f237486a80'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:41.928728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245ca3e8ddbb4add983bb2f237486a80'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:41.954604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:41.992730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-576afb0a-958d-4207-8f74-a66351e4f6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245ca3e8ddbb4add983bb2f237486a80'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:42.070971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ecbd1-e339-4594-98ff-67b55cb8c23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:42.077276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ecbd1-e339-4594-98ff-67b55cb8c23e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:42.098318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 905/1774] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:42.099378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ecbd1-e339-4594-98ff-67b55cb8c23e service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:42.118825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 870/1775] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:41 2022] DELETE /identity/v3/users/245ca3e8ddbb4add983bb2f237486a80 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:42.123889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ecbd1-e339-4594-98ff-67b55cb8c23e service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:42.199729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4a677-66be-4fba-896f-2f2619949da0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.199729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4a677-66be-4fba-896f-2f2619949da0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.200016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4a677-66be-4fba-896f-2f2619949da0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:42.202847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 871/1776] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:01:42.269392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:42.275299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d38b1-1048-4148-9906-3b07927d4c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:42.277051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d38b1-1048-4148-9906-3b07927d4c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.277573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d38b1-1048-4148-9906-3b07927d4c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.278109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d38b1-1048-4148-9906-3b07927d4c41 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:42.279139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d38b1-1048-4148-9906-3b07927d4c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:42.284530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d38b1-1048-4148-9906-3b07927d4c41 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:42.398809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 906/1777] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:42 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:42.402937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4a677-66be-4fba-896f-2f2619949da0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:42.406794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f7b4a677-66be-4fba-896f-2f2619949da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:42.444295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd97989-96d0-4cdb-8364-198ff63be640 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.445266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd97989-96d0-4cdb-8364-198ff63be640 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.447100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd97989-96d0-4cdb-8364-198ff63be640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:42.474128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4a677-66be-4fba-896f-2f2619949da0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:42.492153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22916f0-a89a-41dd-a0e0-2cd66c8e22e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:42.493195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22916f0-a89a-41dd-a0e0-2cd66c8e22e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.497332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3fd97989-96d0-4cdb-8364-198ff63be640 None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:42.497962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22916f0-a89a-41dd-a0e0-2cd66c8e22e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.499148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22916f0-a89a-41dd-a0e0-2cd66c8e22e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:42.504125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3fd97989-96d0-4cdb-8364-198ff63be640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:42.504276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22916f0-a89a-41dd-a0e0-2cd66c8e22e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:42.513025 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22916f0-a89a-41dd-a0e0-2cd66c8e22e0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:42.541806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 872/1778] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:42.544453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22916f0-a89a-41dd-a0e0-2cd66c8e22e0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:42.562387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:42.582412 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22916f0-a89a-41dd-a0e0-2cd66c8e22e0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:42.590115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c7a88-f8c7-4b83-a5b7-510e722e926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:42.590924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7a88-f8c7-4b83-a5b7-510e722e926e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.591091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7a88-f8c7-4b83-a5b7-510e722e926e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.591371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7a88-f8c7-4b83-a5b7-510e722e926e admin admin] PATH_INFO: `/v3/projects/fb23197e5a214ffc964db34484242942/users/591832c82e124c9e81f888629f400e87/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:42.646961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:42.652233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c7a88-f8c7-4b83-a5b7-510e722e926e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb23197e5a214ffc964db34484242942, user_id=591832c82e124c9e81f888629f400e87, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:42.655548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c7a88-f8c7-4b83-a5b7-510e722e926e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:42.731129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 907/1779] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:01:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:42.749284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 873/1780] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:42 2022] PUT /identity/v3/projects/fb23197e5a214ffc964db34484242942/users/591832c82e124c9e81f888629f400e87/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:42.753883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd97989-96d0-4cdb-8364-198ff63be640 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:42.774638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd97989-96d0-4cdb-8364-198ff63be640 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:42.894611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7022328-f815-479e-9bb5-981ff4813159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:42.895327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022328-f815-479e-9bb5-981ff4813159 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.895644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022328-f815-479e-9bb5-981ff4813159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.895972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7022328-f815-479e-9bb5-981ff4813159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:42.896644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7022328-f815-479e-9bb5-981ff4813159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:42.898370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7022328-f815-479e-9bb5-981ff4813159 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:42.917028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:42.925430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 908/1781] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:42.929758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c7a88-f8c7-4b83-a5b7-510e722e926e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:42.948881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c7a88-f8c7-4b83-a5b7-510e722e926e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:42.964323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2b5f8-8681-4efe-8e7b-6d5db41e9032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:42.968485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b5f8-8681-4efe-8e7b-6d5db41e9032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.968485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b5f8-8681-4efe-8e7b-6d5db41e9032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.968485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b5f8-8681-4efe-8e7b-6d5db41e9032 admin admin] PATH_INFO: `/v3/projects/fb23197e5a214ffc964db34484242942/users/591832c82e124c9e81f888629f400e87/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:42.968485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2b5f8-8681-4efe-8e7b-6d5db41e9032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb23197e5a214ffc964db34484242942, user_id=591832c82e124c9e81f888629f400e87, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:42.972760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2b5f8-8681-4efe-8e7b-6d5db41e9032 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:42.996024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 874/1782] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:42 2022] PUT /identity/v3/projects/fb23197e5a214ffc964db34484242942/users/591832c82e124c9e81f888629f400e87/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:42.998542 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe5b2-88e3-4272-b57d-40cbb853b6ca None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.999145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe5b2-88e3-4272-b57d-40cbb853b6ca None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.999589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe5b2-88e3-4272-b57d-40cbb853b6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.090073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5fcbe5b2-88e3-4272-b57d-40cbb853b6ca None None] MFA Rules not processed for user `591832c82e124c9e81f888629f400e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:43.091676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fcbe5b2-88e3-4272-b57d-40cbb853b6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:43.166559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2b5f8-8681-4efe-8e7b-6d5db41e9032 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.168736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6ac2b5f8-8681-4efe-8e7b-6d5db41e9032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:43.259880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 909/1783] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:43.307063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbe5b2-88e3-4272-b57d-40cbb853b6ca None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.320624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5fcbe5b2-88e3-4272-b57d-40cbb853b6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:43.361857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2b5f8-8681-4efe-8e7b-6d5db41e9032 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.370429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df32b09-b48a-465b-98ce-809c861ebefb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.371285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df32b09-b48a-465b-98ce-809c861ebefb service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.371809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df32b09-b48a-465b-98ce-809c861ebefb service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.372340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df32b09-b48a-465b-98ce-809c861ebefb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.387771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df32b09-b48a-465b-98ce-809c861ebefb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.391100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df32b09-b48a-465b-98ce-809c861ebefb service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:43.426393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 875/1784] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:43.445841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df32b09-b48a-465b-98ce-809c861ebefb service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.453987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8df32b09-b48a-465b-98ce-809c861ebefb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:43.458164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbe5b2-88e3-4272-b57d-40cbb853b6ca None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.471412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f76aa-eb6e-4182-affb-f4a228821db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.473539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f76aa-eb6e-4182-affb-f4a228821db7 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.476977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f76aa-eb6e-4182-affb-f4a228821db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.477603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f76aa-eb6e-4182-affb-f4a228821db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.523520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f76aa-eb6e-4182-affb-f4a228821db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.524916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f76aa-eb6e-4182-affb-f4a228821db7 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:43.568620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 910/1785] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:01:43.607456 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:43.665020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df32b09-b48a-465b-98ce-809c861ebefb service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.680863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.682053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.682610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.683081 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] PATH_INFO: `/v3/projects/cba69e790c8d47f883b728529d6bfd35` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.684854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a4c80-3946-483d-897f-5273539fb723 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.685153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a4c80-3946-483d-897f-5273539fb723 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.685344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba69e790c8d47f883b728529d6bfd35)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.685440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a4c80-3946-483d-897f-5273539fb723 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.686887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 911/1786] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 09:01:43.688804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:43.726363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053d01b-ae2e-4ab6-acc2-8d77f7c0fc65 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.727276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053d01b-ae2e-4ab6-acc2-8d77f7c0fc65 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.729130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053d01b-ae2e-4ab6-acc2-8d77f7c0fc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.820295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9053d01b-ae2e-4ab6-acc2-8d77f7c0fc65 None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:43.825059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9053d01b-ae2e-4ab6-acc2-8d77f7c0fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:43.854457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 912/1787] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:01:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:43.912323 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba69e790c8d47f883b728529d6bfd35', 'request_id': 'req-6c0d7448-944d-426b-b7ac-11c34990812f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:43.920244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba69e790c8d47f883b728529d6bfd35', 'request_id': 'req-6c0d7448-944d-426b-b7ac-11c34990812f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:43.937307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba69e790c8d47f883b728529d6bfd35', 'request_id': 'req-6c0d7448-944d-426b-b7ac-11c34990812f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:43.961673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053d01b-ae2e-4ab6-acc2-8d77f7c0fc65 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.980791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053d01b-ae2e-4ab6-acc2-8d77f7c0fc65 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:44.080128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] The token cache is being invalidate because project cba69e790c8d47f883b728529d6bfd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:44.080709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:44.081992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6c0d7448-944d-426b-b7ac-11c34990812f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:44.087822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 876/1788] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:43 2022] DELETE /identity/v3/projects/cba69e790c8d47f883b728529d6bfd35 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:44.093020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc095b4-d8f2-440e-8aef-7bfe51d799f2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.093491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc095b4-d8f2-440e-8aef-7bfe51d799f2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.095281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc095b4-d8f2-440e-8aef-7bfe51d799f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.150556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9cc095b4-d8f2-440e-8aef-7bfe51d799f2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:44.154060 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9cc095b4-d8f2-440e-8aef-7bfe51d799f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:44.210449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:44.210449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.210449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.210449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.231999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:44.281867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:44.281867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:44.324232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 913/1789] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:01:44.335247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:44.339407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:44.360500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:44.367587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 877/1790] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:01:44.377612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b85235-5eff-4b9e-b242-2ef3ab922e2f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.380358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b85235-5eff-4b9e-b242-2ef3ab922e2f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.381542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b85235-5eff-4b9e-b242-2ef3ab922e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.441994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-81b85235-5eff-4b9e-b242-2ef3ab922e2f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:44.443672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-81b85235-5eff-4b9e-b242-2ef3ab922e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:44.473737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 878/1791] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:44.476274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b85235-5eff-4b9e-b242-2ef3ab922e2f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:44.507527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b85235-5eff-4b9e-b242-2ef3ab922e2f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:44.520871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87a5d-6d9b-4a7a-b5a1-2fbb3c4245bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:44.521579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87a5d-6d9b-4a7a-b5a1-2fbb3c4245bd admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.521873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87a5d-6d9b-4a7a-b5a1-2fbb3c4245bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.522180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b87a5d-6d9b-4a7a-b5a1-2fbb3c4245bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.523488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b87a5d-6d9b-4a7a-b5a1-2fbb3c4245bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:44.523804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b87a5d-6d9b-4a7a-b5a1-2fbb3c4245bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:44.526511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b87a5d-6d9b-4a7a-b5a1-2fbb3c4245bd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:44.561993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:44.582132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 879/1792] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:44.606634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87a5d-6d9b-4a7a-b5a1-2fbb3c4245bd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:44.615854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc8f6f-e8d8-49b8-b544-771c7f24556a service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:44.630050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:44.633065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.634352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.635114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] PATH_INFO: `/v3/projects/8bb21417664e4e0e8755d4af8a8bd84e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.638033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb21417664e4e0e8755d4af8a8bd84e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:44.645203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b87a5d-6d9b-4a7a-b5a1-2fbb3c4245bd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:44.646381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:44.662620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf4a30-3149-4ab4-ba91-05aea9a9c518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:44.665377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4a30-3149-4ab4-ba91-05aea9a9c518 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.674036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4a30-3149-4ab4-ba91-05aea9a9c518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.674036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf4a30-3149-4ab4-ba91-05aea9a9c518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.674036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf4a30-3149-4ab4-ba91-05aea9a9c518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:44.681482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf4a30-3149-4ab4-ba91-05aea9a9c518 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:44.838932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 880/1793] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:44 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:44.850555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf4a30-3149-4ab4-ba91-05aea9a9c518 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:44.865536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb21417664e4e0e8755d4af8a8bd84e', 'request_id': 'req-594e59b3-7ea8-46cf-9084-30158a47b70f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:44.900037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb21417664e4e0e8755d4af8a8bd84e', 'request_id': 'req-594e59b3-7ea8-46cf-9084-30158a47b70f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:44.974463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf4a30-3149-4ab4-ba91-05aea9a9c518 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:44.981987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d7008-0991-4808-86e3-beabfe46ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:44.983050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d7008-0991-4808-86e3-beabfe46ee54 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.983884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d7008-0991-4808-86e3-beabfe46ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.984263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d7008-0991-4808-86e3-beabfe46ee54 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.985034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d7008-0991-4808-86e3-beabfe46ee54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:44.988955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d7008-0991-4808-86e3-beabfe46ee54 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.000081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb21417664e4e0e8755d4af8a8bd84e', 'request_id': 'req-594e59b3-7ea8-46cf-9084-30158a47b70f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.023896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] The token cache is being invalidate because project 8bb21417664e4e0e8755d4af8a8bd84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:45.024520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.025524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.028333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 914/1794] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:44 2022] DELETE /identity/v3/projects/8bb21417664e4e0e8755d4af8a8bd84e => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:45.038602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.040276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:45.128695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 881/1795] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:44 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:01:45.132566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d7008-0991-4808-86e3-beabfe46ee54 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.136947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a95d7008-0991-4808-86e3-beabfe46ee54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:45.163026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e59b3-7ea8-46cf-9084-30158a47b70f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.181036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.186309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.186430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d7008-0991-4808-86e3-beabfe46ee54 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.186521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.186521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] PATH_INFO: `/v3/users/2c195120a6b548ae9a3ede7d1b06f458` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.186521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c195120a6b548ae9a3ede7d1b06f458)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.190473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.209197 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6deb18-1d27-4c4a-87be-9876fb0fed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.215006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6deb18-1d27-4c4a-87be-9876fb0fed66 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.215006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6deb18-1d27-4c4a-87be-9876fb0fed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.215006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6deb18-1d27-4c4a-87be-9876fb0fed66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.215006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6deb18-1d27-4c4a-87be-9876fb0fed66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.215006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6deb18-1d27-4c4a-87be-9876fb0fed66 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.236159 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 882/1796] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:45.239404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6deb18-1d27-4c4a-87be-9876fb0fed66 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.276347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:45.286515 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6deb18-1d27-4c4a-87be-9876fb0fed66 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.300553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c7979-d83e-451c-8ac9-178a4586529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.300553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c7979-d83e-451c-8ac9-178a4586529f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.300553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c7979-d83e-451c-8ac9-178a4586529f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.313113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c7979-d83e-451c-8ac9-178a4586529f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.313953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c7979-d83e-451c-8ac9-178a4586529f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.321059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c7979-d83e-451c-8ac9-178a4586529f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.354694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 883/1797] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:45.362057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c7979-d83e-451c-8ac9-178a4586529f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.388275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c7979-d83e-451c-8ac9-178a4586529f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.398905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dbdd4-d65e-4b5c-ab21-911e5868c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.400083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dbdd4-d65e-4b5c-ab21-911e5868c86e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.400488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dbdd4-d65e-4b5c-ab21-911e5868c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.401322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dbdd4-d65e-4b5c-ab21-911e5868c86e admin admin] PATH_INFO: `/v3/projects/8d90e18171c9454e8a04123e893c4a63/users/03cac518024f477da693e7a1ab39a912/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.428755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dbdd4-d65e-4b5c-ab21-911e5868c86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d90e18171c9454e8a04123e893c4a63, user_id=03cac518024f477da693e7a1ab39a912, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.433000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dbdd4-d65e-4b5c-ab21-911e5868c86e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.503577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c195120a6b548ae9a3ede7d1b06f458'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.504697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c195120a6b548ae9a3ede7d1b06f458'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.529676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c195120a6b548ae9a3ede7d1b06f458'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.557355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 884/1798] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:45 2022] PUT /identity/v3/projects/8d90e18171c9454e8a04123e893c4a63/users/03cac518024f477da693e7a1ab39a912/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:45.571989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec15ca-5aac-44b8-893d-2187ee36de33 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.572329 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec15ca-5aac-44b8-893d-2187ee36de33 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.572622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec15ca-5aac-44b8-893d-2187ee36de33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.621812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-91ec15ca-5aac-44b8-893d-2187ee36de33 None None] MFA Rules not processed for user `03cac518024f477da693e7a1ab39a912`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:45.623835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-91ec15ca-5aac-44b8-893d-2187ee36de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:45.637905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c195120a6b548ae9a3ede7d1b06f458'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.639718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c195120a6b548ae9a3ede7d1b06f458'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.694310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 915/1799] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:45 2022] DELETE /identity/v3/users/2c195120a6b548ae9a3ede7d1b06f458 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:01:45.695234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.697999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:45.810361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 885/1800] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:01:45.815023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec15ca-5aac-44b8-893d-2187ee36de33 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.819834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-91ec15ca-5aac-44b8-893d-2187ee36de33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:45.942541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5464a-8e50-4a19-afe9-0e4cab5c7d66 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.955296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.956159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.956536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.956908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] PATH_INFO: `/v3/users/bcbb590088224c19b2a4a3869be8e560` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.958452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbb590088224c19b2a4a3869be8e560)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.960555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.969251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec15ca-5aac-44b8-893d-2187ee36de33 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.978717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ff7d2-8a3d-41dc-a039-dd6f68d347cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.979357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ff7d2-8a3d-41dc-a039-dd6f68d347cf admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.979646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ff7d2-8a3d-41dc-a039-dd6f68d347cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.979924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ff7d2-8a3d-41dc-a039-dd6f68d347cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.980643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ff7d2-8a3d-41dc-a039-dd6f68d347cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.983228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ff7d2-8a3d-41dc-a039-dd6f68d347cf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.114155 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 886/1801] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:45 2022] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:46.116616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ff7d2-8a3d-41dc-a039-dd6f68d347cf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.233916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ff7d2-8a3d-41dc-a039-dd6f68d347cf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.245409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9029cf4-8e4a-47af-8e0a-269c24c9ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.254657 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:46.262215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9029cf4-8e4a-47af-8e0a-269c24c9ad68 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.262744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9029cf4-8e4a-47af-8e0a-269c24c9ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.264176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9029cf4-8e4a-47af-8e0a-269c24c9ad68 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.265040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9029cf4-8e4a-47af-8e0a-269c24c9ad68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.274483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9029cf4-8e4a-47af-8e0a-269c24c9ad68 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.348743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbb590088224c19b2a4a3869be8e560'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:46.352884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbb590088224c19b2a4a3869be8e560'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:46.390452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbb590088224c19b2a4a3869be8e560'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:46.409629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 887/1802] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:46 2022] POST /identity/v3/users => generated 294 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:46.414009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9029cf4-8e4a-47af-8e0a-269c24c9ad68 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.503224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbb590088224c19b2a4a3869be8e560'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:46.504342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fe9f9906-abbe-4aa6-ab49-c7036b77a9f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbb590088224c19b2a4a3869be8e560'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:46.505247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9029cf4-8e4a-47af-8e0a-269c24c9ad68 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.532338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd4f84-9935-4b4e-a907-07fb14eba793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.535681 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd4f84-9935-4b4e-a907-07fb14eba793 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.535978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd4f84-9935-4b4e-a907-07fb14eba793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.541321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd4f84-9935-4b4e-a907-07fb14eba793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.541321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd4f84-9935-4b4e-a907-07fb14eba793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.546867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd4f84-9935-4b4e-a907-07fb14eba793 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.554247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 916/1803] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:45 2022] DELETE /identity/v3/users/bcbb590088224c19b2a4a3869be8e560 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:46.562468 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554b89d-616c-4495-90fc-e0d8e9b5e999 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.564617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554b89d-616c-4495-90fc-e0d8e9b5e999 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.567076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554b89d-616c-4495-90fc-e0d8e9b5e999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.612314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 888/1804] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:46.613458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd4f84-9935-4b4e-a907-07fb14eba793 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.623586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0cd4f84-9935-4b4e-a907-07fb14eba793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:46.643838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c554b89d-616c-4495-90fc-e0d8e9b5e999 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:46.648051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c554b89d-616c-4495-90fc-e0d8e9b5e999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:46.654620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd4f84-9935-4b4e-a907-07fb14eba793 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.807684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34ce6c-942a-4268-b14b-d829878f72b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.809405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34ce6c-942a-4268-b14b-d829878f72b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.810483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34ce6c-942a-4268-b14b-d829878f72b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.817183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34ce6c-942a-4268-b14b-d829878f72b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.819310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34ce6c-942a-4268-b14b-d829878f72b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.822181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34ce6c-942a-4268-b14b-d829878f72b0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.839926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 917/1805] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:46.848639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 889/1806] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:46.852976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554b89d-616c-4495-90fc-e0d8e9b5e999 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.865234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34ce6c-942a-4268-b14b-d829878f72b0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.867705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554b89d-616c-4495-90fc-e0d8e9b5e999 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.870276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f34ce6c-942a-4268-b14b-d829878f72b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:46.897478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:46.901763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6873cc-919b-454b-9b0b-fe850c2f25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.903804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6873cc-919b-454b-9b0b-fe850c2f25a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.904980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6873cc-919b-454b-9b0b-fe850c2f25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.904980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6873cc-919b-454b-9b0b-fe850c2f25a1 admin admin] PATH_INFO: `/v3/projects/7431a1c8e9f249eda90fc78c45ba9367/users/30a8bcb4bcb449f69116764691abd9f2/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.967501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6873cc-919b-454b-9b0b-fe850c2f25a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7431a1c8e9f249eda90fc78c45ba9367, user_id=30a8bcb4bcb449f69116764691abd9f2, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.971428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6873cc-919b-454b-9b0b-fe850c2f25a1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:47.022585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34ce6c-942a-4268-b14b-d829878f72b0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:47.045183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa059-5cd0-4e01-8f2c-bece8c02770a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:47.045885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa059-5cd0-4e01-8f2c-bece8c02770a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:47.046215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa059-5cd0-4e01-8f2c-bece8c02770a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:47.048788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aa059-5cd0-4e01-8f2c-bece8c02770a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:47.070545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 918/1807] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:46 2022] PUT /identity/v3/projects/7431a1c8e9f249eda90fc78c45ba9367/users/30a8bcb4bcb449f69116764691abd9f2/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:47.073595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df503e8-c06b-403d-9577-921f94c8b876 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:47.074005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df503e8-c06b-403d-9577-921f94c8b876 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:47.074368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df503e8-c06b-403d-9577-921f94c8b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:47.077273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aa059-5cd0-4e01-8f2c-bece8c02770a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:47.077273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aa059-5cd0-4e01-8f2c-bece8c02770a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:47.103841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 890/1808] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:47.176407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7df503e8-c06b-403d-9577-921f94c8b876 None None] MFA Rules not processed for user `30a8bcb4bcb449f69116764691abd9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:47.177871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7df503e8-c06b-403d-9577-921f94c8b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:47.298483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 919/1809] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:47.298646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa059-5cd0-4e01-8f2c-bece8c02770a service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:47.321078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aa059-5cd0-4e01-8f2c-bece8c02770a service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:47.452385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd80c-5571-4cbd-b01c-6a29d2f4a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:47.453597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd80c-5571-4cbd-b01c-6a29d2f4a98b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:47.453597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd80c-5571-4cbd-b01c-6a29d2f4a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:47.453738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd80c-5571-4cbd-b01c-6a29d2f4a98b admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:47.455308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd80c-5571-4cbd-b01c-6a29d2f4a98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:47.457730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd80c-5571-4cbd-b01c-6a29d2f4a98b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:47.556395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 891/1810] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:47 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:47.558894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df503e8-c06b-403d-9577-921f94c8b876 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:47.577913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df503e8-c06b-403d-9577-921f94c8b876 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:47.611254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:47.708892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cdcb6-9ba4-48a6-be61-83ef5c8933ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:47.709663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cdcb6-9ba4-48a6-be61-83ef5c8933ef admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:47.710011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cdcb6-9ba4-48a6-be61-83ef5c8933ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:47.728319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd80c-5571-4cbd-b01c-6a29d2f4a98b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:47.730632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f2dd80c-5571-4cbd-b01c-6a29d2f4a98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:47.739436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cdcb6-9ba4-48a6-be61-83ef5c8933ef admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:47.741085 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cdcb6-9ba4-48a6-be61-83ef5c8933ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:47.746804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cdcb6-9ba4-48a6-be61-83ef5c8933ef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:47.765234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd80c-5571-4cbd-b01c-6a29d2f4a98b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:47.779822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:47.782402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:47.783859 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:47.784325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] PATH_INFO: `/v3/projects/7c3ad8edede5456fb96743a19f5fadd7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:47.803395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3ad8edede5456fb96743a19f5fadd7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:47.803395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:47.865399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 920/1811] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:47 2022] POST /identity/v3/users => generated 299 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:47.869253 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cdcb6-9ba4-48a6-be61-83ef5c8933ef admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:47.903630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cdcb6-9ba4-48a6-be61-83ef5c8933ef admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:47.918471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a2d20-20ed-4624-97f3-e52fff12b51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:47.918471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2d20-20ed-4624-97f3-e52fff12b51b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:47.918471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2d20-20ed-4624-97f3-e52fff12b51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:47.918471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2d20-20ed-4624-97f3-e52fff12b51b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:47.918884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a2d20-20ed-4624-97f3-e52fff12b51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:47.921796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a2d20-20ed-4624-97f3-e52fff12b51b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:47.978250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 921/1812] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:47.979247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a2d20-20ed-4624-97f3-e52fff12b51b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:48.000291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a2d20-20ed-4624-97f3-e52fff12b51b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:48.022027 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3ad8edede5456fb96743a19f5fadd7', 'request_id': 'req-dff6cc42-9461-4922-abff-0ddfe2beadf8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.039552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3ad8edede5456fb96743a19f5fadd7', 'request_id': 'req-dff6cc42-9461-4922-abff-0ddfe2beadf8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.050821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3ad8edede5456fb96743a19f5fadd7', 'request_id': 'req-dff6cc42-9461-4922-abff-0ddfe2beadf8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.090052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72a181-2428-4911-9aab-880a928ba74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:48.090978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72a181-2428-4911-9aab-880a928ba74f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:48.091331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72a181-2428-4911-9aab-880a928ba74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:48.091720 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72a181-2428-4911-9aab-880a928ba74f admin admin] PATH_INFO: `/v3/projects/574e494c09384d93bfe1729a946503e1/users/870e3777744b4c7f8e5e648946c75248/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:48.111256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72a181-2428-4911-9aab-880a928ba74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=574e494c09384d93bfe1729a946503e1, user_id=870e3777744b4c7f8e5e648946c75248, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:48.114506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72a181-2428-4911-9aab-880a928ba74f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:48.191389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] The token cache is being invalidate because project 7c3ad8edede5456fb96743a19f5fadd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:48.191689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.192471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dff6cc42-9461-4922-abff-0ddfe2beadf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.194486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 892/1813] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:47 2022] DELETE /identity/v3/projects/7c3ad8edede5456fb96743a19f5fadd7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:48.199906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23ab3e-a302-409e-a4d5-bec17720c38e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:48.200220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23ab3e-a302-409e-a4d5-bec17720c38e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:48.200549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23ab3e-a302-409e-a4d5-bec17720c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:48.249873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-df23ab3e-a302-409e-a4d5-bec17720c38e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:48.251190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-df23ab3e-a302-409e-a4d5-bec17720c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:48.272226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 922/1814] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:47 2022] PUT /identity/v3/projects/574e494c09384d93bfe1729a946503e1/users/870e3777744b4c7f8e5e648946c75248/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:48.273216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72a181-2428-4911-9aab-880a928ba74f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:48.275135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df72a181-2428-4911-9aab-880a928ba74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:48.299438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 893/1815] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:48.300477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23ab3e-a302-409e-a4d5-bec17720c38e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:48.303758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-df23ab3e-a302-409e-a4d5-bec17720c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:48.326949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23ab3e-a302-409e-a4d5-bec17720c38e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:48.385438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72a181-2428-4911-9aab-880a928ba74f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:48.391264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:48.393174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:48.393520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:48.394776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] PATH_INFO: `/v3/projects/14111257264f42b5a564bb18c9911fdb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:48.395019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:48.396006 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14111257264f42b5a564bb18c9911fdb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:48.398651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:48.517113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9683212-284f-439b-905a-af23a390b496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:48.518568 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9683212-284f-439b-905a-af23a390b496 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:48.519184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9683212-284f-439b-905a-af23a390b496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:48.520201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9683212-284f-439b-905a-af23a390b496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:48.523200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9683212-284f-439b-905a-af23a390b496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:48.525077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9683212-284f-439b-905a-af23a390b496 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:48.557522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14111257264f42b5a564bb18c9911fdb', 'request_id': 'req-693cc88f-ee68-4bf6-a8a1-74818ac5a573'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.574478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14111257264f42b5a564bb18c9911fdb', 'request_id': 'req-693cc88f-ee68-4bf6-a8a1-74818ac5a573'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.580689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 894/1816] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:48.582159 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f4a5-e65f-4f01-a514-ef917cf6335d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:48.586046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f4a5-e65f-4f01-a514-ef917cf6335d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:48.586376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f4a5-e65f-4f01-a514-ef917cf6335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:48.626326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7946f4a5-e65f-4f01-a514-ef917cf6335d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:48.628729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7946f4a5-e65f-4f01-a514-ef917cf6335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:48.662850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14111257264f42b5a564bb18c9911fdb', 'request_id': 'req-693cc88f-ee68-4bf6-a8a1-74818ac5a573'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.697100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] The token cache is being invalidate because project 14111257264f42b5a564bb18c9911fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:48.697647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.714644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:48.719114 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 923/1817] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:48 2022] DELETE /identity/v3/projects/14111257264f42b5a564bb18c9911fdb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:48.720022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:48.726967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:48.786890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 895/1818] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:48.790150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946f4a5-e65f-4f01-a514-ef917cf6335d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:48.812094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7946f4a5-e65f-4f01-a514-ef917cf6335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:48.861105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946f4a5-e65f-4f01-a514-ef917cf6335d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:48.873628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:48.874254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:48.874667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:48.874802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] PATH_INFO: `/v3/users/591832c82e124c9e81f888629f400e87` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:48.878826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=591832c82e124c9e81f888629f400e87)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:48.893903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:48.949406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cc88f-ee68-4bf6-a8a1-74818ac5a573 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:48.970180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea542c-b2d1-41e3-9023-a42428a4a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:48.970916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea542c-b2d1-41e3-9023-a42428a4a9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:48.971198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea542c-b2d1-41e3-9023-a42428a4a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:48.971559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea542c-b2d1-41e3-9023-a42428a4a9a5 admin admin] PATH_INFO: `/v3/projects/574e494c09384d93bfe1729a946503e1/users/870e3777744b4c7f8e5e648946c75248/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:48.988475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea542c-b2d1-41e3-9023-a42428a4a9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574e494c09384d93bfe1729a946503e1, user_id=870e3777744b4c7f8e5e648946c75248, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:48.994297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea542c-b2d1-41e3-9023-a42428a4a9a5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:49.021656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 924/1819] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:48 2022] PUT /identity/v3/projects/574e494c09384d93bfe1729a946503e1/users/870e3777744b4c7f8e5e648946c75248/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:49.023033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea542c-b2d1-41e3-9023-a42428a4a9a5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:49.135721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea542c-b2d1-41e3-9023-a42428a4a9a5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:49.143181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca010e-b97e-4031-9a1b-296e268237f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:49.143838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca010e-b97e-4031-9a1b-296e268237f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:49.144132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca010e-b97e-4031-9a1b-296e268237f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:49.144417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca010e-b97e-4031-9a1b-296e268237f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:49.145118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca010e-b97e-4031-9a1b-296e268237f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:49.145434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca010e-b97e-4031-9a1b-296e268237f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:49.153449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca010e-b97e-4031-9a1b-296e268237f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:49.174124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591832c82e124c9e81f888629f400e87'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:49.174839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591832c82e124c9e81f888629f400e87'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:49.178531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 925/1820] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:49.179939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26e718-1efb-4255-a799-176239e6f724 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:49.180261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26e718-1efb-4255-a799-176239e6f724 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:49.180536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26e718-1efb-4255-a799-176239e6f724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:49.182367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591832c82e124c9e81f888629f400e87'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:49.183053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591832c82e124c9e81f888629f400e87'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:49.213886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591832c82e124c9e81f888629f400e87'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:49.214500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-af26e718-1efb-4255-a799-176239e6f724 None None] MFA Rules not processed for user `870e3777744b4c7f8e5e648946c75248`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:49.216050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-af26e718-1efb-4255-a799-176239e6f724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:49.306664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 926/1821] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:49.307608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26e718-1efb-4255-a799-176239e6f724 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:49.309951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-af26e718-1efb-4255-a799-176239e6f724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:49.324337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26e718-1efb-4255-a799-176239e6f724 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:49.328978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69ca07-ce2e-46a8-95ed-07a598e01620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:49.333460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69ca07-ce2e-46a8-95ed-07a598e01620 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:49.333460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69ca07-ce2e-46a8-95ed-07a598e01620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:49.333460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69ca07-ce2e-46a8-95ed-07a598e01620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:49.333460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69ca07-ce2e-46a8-95ed-07a598e01620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:49.333460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69ca07-ce2e-46a8-95ed-07a598e01620 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:49.335542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 896/1822] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:48 2022] DELETE /identity/v3/users/591832c82e124c9e81f888629f400e87 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:49.336457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:49.350677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:49.422342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 927/1823] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:49 2022] POST /identity/v3/projects => generated 401 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:49.427324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69ca07-ce2e-46a8-95ed-07a598e01620 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:49.496266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:49.509318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42147b0-d2b3-42a6-bf6e-cb2d3a3e8208 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:49.570804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69ca07-ce2e-46a8-95ed-07a598e01620 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:49.577145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22838f-7ee4-4143-a8ef-ded025ea8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:49.577906 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22838f-7ee4-4143-a8ef-ded025ea8793 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:49.578148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22838f-7ee4-4143-a8ef-ded025ea8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:49.578921 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22838f-7ee4-4143-a8ef-ded025ea8793 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:49.579812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22838f-7ee4-4143-a8ef-ded025ea8793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:49.582267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22838f-7ee4-4143-a8ef-ded025ea8793 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:49.645075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292b654-e23b-438b-8637-42f895b9d820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:49.645941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292b654-e23b-438b-8637-42f895b9d820 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:49.646444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292b654-e23b-438b-8637-42f895b9d820 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:49.646974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292b654-e23b-438b-8637-42f895b9d820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:49.673568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 928/1824] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:49 2022] POST /identity/v3/users => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:49.676574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22838f-7ee4-4143-a8ef-ded025ea8793 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:49.687765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22838f-7ee4-4143-a8ef-ded025ea8793 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:49.693383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3aec6-a9ea-4fef-b635-44e78dfc6865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:49.704631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3aec6-a9ea-4fef-b635-44e78dfc6865 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:49.705035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3aec6-a9ea-4fef-b635-44e78dfc6865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:49.705492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3aec6-a9ea-4fef-b635-44e78dfc6865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:49.708030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3aec6-a9ea-4fef-b635-44e78dfc6865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:49.709698 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3aec6-a9ea-4fef-b635-44e78dfc6865 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:49.750932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 929/1825] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:49.750932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3aec6-a9ea-4fef-b635-44e78dfc6865 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:49.753771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3aec6-a9ea-4fef-b635-44e78dfc6865 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:49.759375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c9c1d-e08c-45db-a180-2c2e7e15dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:49.759982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c9c1d-e08c-45db-a180-2c2e7e15dc67 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:49.760254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c9c1d-e08c-45db-a180-2c2e7e15dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:49.760669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c9c1d-e08c-45db-a180-2c2e7e15dc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:49.761231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c9c1d-e08c-45db-a180-2c2e7e15dc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:49.762978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c9c1d-e08c-45db-a180-2c2e7e15dc67 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:49.772737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292b654-e23b-438b-8637-42f895b9d820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:49.775006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292b654-e23b-438b-8637-42f895b9d820 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:49.792394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 930/1826] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:01:49.793158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c9c1d-e08c-45db-a180-2c2e7e15dc67 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:49.805922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 897/1827] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:49.821214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c9c1d-e08c-45db-a180-2c2e7e15dc67 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:49.828513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd317-b3d8-4476-a018-1519f798354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:49.830150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd317-b3d8-4476-a018-1519f798354b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:49.830480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd317-b3d8-4476-a018-1519f798354b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:49.830761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bd317-b3d8-4476-a018-1519f798354b admin admin] PATH_INFO: `/v3/projects/57ec4440c7ae4dd38317d5ad1403ac98/users/1fe5466ce57648eeaaf674103a6d71a1/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:49.850631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bd317-b3d8-4476-a018-1519f798354b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ec4440c7ae4dd38317d5ad1403ac98, user_id=1fe5466ce57648eeaaf674103a6d71a1, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:49.853668 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bd317-b3d8-4476-a018-1519f798354b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:49.963025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 931/1828] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:49 2022] PUT /identity/v3/projects/57ec4440c7ae4dd38317d5ad1403ac98/users/1fe5466ce57648eeaaf674103a6d71a1/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:49.973314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0ad5a-96f8-4564-acff-6a6974608006 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:49.973705 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0ad5a-96f8-4564-acff-6a6974608006 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:49.974180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0ad5a-96f8-4564-acff-6a6974608006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:50.093402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-01f0ad5a-96f8-4564-acff-6a6974608006 None None] MFA Rules not processed for user `1fe5466ce57648eeaaf674103a6d71a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:50.093402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-01f0ad5a-96f8-4564-acff-6a6974608006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:50.259041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 898/1829] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:50.263146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd317-b3d8-4476-a018-1519f798354b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:50.349240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:50.406306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bd317-b3d8-4476-a018-1519f798354b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:50.425798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039eb9f-f4e2-4957-a9ec-f740629e4de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:50.426464 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039eb9f-f4e2-4957-a9ec-f740629e4de7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:50.429626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039eb9f-f4e2-4957-a9ec-f740629e4de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:50.429898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039eb9f-f4e2-4957-a9ec-f740629e4de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:50.430631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039eb9f-f4e2-4957-a9ec-f740629e4de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:50.432624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039eb9f-f4e2-4957-a9ec-f740629e4de7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:50.541096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0ad5a-96f8-4564-acff-6a6974608006 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:50.542707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-01f0ad5a-96f8-4564-acff-6a6974608006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:50.571052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 932/1830] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:50 2022] POST /identity/v3/projects => generated 401 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:50.572423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039eb9f-f4e2-4957-a9ec-f740629e4de7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:50.588264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0ad5a-96f8-4564-acff-6a6974608006 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:50.708759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039eb9f-f4e2-4957-a9ec-f740629e4de7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:50.722835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ae53-bdbf-4532-bfea-cfe0ab3ea6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:50.723826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ae53-bdbf-4532-bfea-cfe0ab3ea6db admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:50.724338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ae53-bdbf-4532-bfea-cfe0ab3ea6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:50.725170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ae53-bdbf-4532-bfea-cfe0ab3ea6db admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:50.726292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ae53-bdbf-4532-bfea-cfe0ab3ea6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:50.730124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:50.731302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:50.731821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:50.732296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] PATH_INFO: `/v3/projects/fb23197e5a214ffc964db34484242942` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:50.734885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ae53-bdbf-4532-bfea-cfe0ab3ea6db admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:50.736030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb23197e5a214ffc964db34484242942)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:50.739031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:50.894848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 933/1831] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:50 2022] POST /identity/v3/users => generated 307 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:50.899286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ae53-bdbf-4532-bfea-cfe0ab3ea6db admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:50.911565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ae53-bdbf-4532-bfea-cfe0ab3ea6db admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:50.917049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b53ff5-d5d1-48cf-bc61-003ffabac792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:50.925165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b53ff5-d5d1-48cf-bc61-003ffabac792 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:50.927676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b53ff5-d5d1-48cf-bc61-003ffabac792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:50.927964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b53ff5-d5d1-48cf-bc61-003ffabac792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:50.928673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b53ff5-d5d1-48cf-bc61-003ffabac792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:50.930348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b53ff5-d5d1-48cf-bc61-003ffabac792 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:50.959427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb23197e5a214ffc964db34484242942', 'request_id': 'req-20972c58-84f6-4550-b0f6-f7ef8cd7cece'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:50.963760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 934/1832] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:01:50.964890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b53ff5-d5d1-48cf-bc61-003ffabac792 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:50.972088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb23197e5a214ffc964db34484242942', 'request_id': 'req-20972c58-84f6-4550-b0f6-f7ef8cd7cece'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:50.979298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb23197e5a214ffc964db34484242942', 'request_id': 'req-20972c58-84f6-4550-b0f6-f7ef8cd7cece'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:50.981120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b53ff5-d5d1-48cf-bc61-003ffabac792 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.063115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2bac-0e75-4adc-95a7-c2d9815164ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.064213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2bac-0e75-4adc-95a7-c2d9815164ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.071320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2bac-0e75-4adc-95a7-c2d9815164ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.071801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2bac-0e75-4adc-95a7-c2d9815164ad admin admin] PATH_INFO: `/v3/projects/088fd6983e9244e284abfbb236a41b70/users/a911c208854645ed9aa0752a039a408a/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.088399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] The token cache is being invalidate because project fb23197e5a214ffc964db34484242942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:51.088945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:51.089903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-20972c58-84f6-4550-b0f6-f7ef8cd7cece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:51.096018 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 899/1833] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:50 2022] DELETE /identity/v3/projects/fb23197e5a214ffc964db34484242942 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:51.098106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7363ee-c810-471d-828d-c54a1a8b0316 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.098558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7363ee-c810-471d-828d-c54a1a8b0316 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.098976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7363ee-c810-471d-828d-c54a1a8b0316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.110110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c2bac-0e75-4adc-95a7-c2d9815164ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=088fd6983e9244e284abfbb236a41b70, user_id=a911c208854645ed9aa0752a039a408a, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:51.114348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c2bac-0e75-4adc-95a7-c2d9815164ad admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:51.145785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2d7363ee-c810-471d-828d-c54a1a8b0316 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:51.147547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2d7363ee-c810-471d-828d-c54a1a8b0316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:51.164440 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 900/1834] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:51.182394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4788-eb92-46b0-a2c2-e828132c03c5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.182394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4788-eb92-46b0-a2c2-e828132c03c5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.182394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4788-eb92-46b0-a2c2-e828132c03c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.196511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a8ac4788-eb92-46b0-a2c2-e828132c03c5 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:51.197744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a8ac4788-eb92-46b0-a2c2-e828132c03c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:51.215436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 901/1835] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:51.221450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4788-eb92-46b0-a2c2-e828132c03c5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:51.230768 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4788-eb92-46b0-a2c2-e828132c03c5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.236272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842686e3-4ca4-40a9-a145-868240af347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.236893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842686e3-4ca4-40a9-a145-868240af347d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.237169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842686e3-4ca4-40a9-a145-868240af347d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.237455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842686e3-4ca4-40a9-a145-868240af347d admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.238125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842686e3-4ca4-40a9-a145-868240af347d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:51.238453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842686e3-4ca4-40a9-a145-868240af347d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:51.240741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842686e3-4ca4-40a9-a145-868240af347d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:51.253175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 902/1836] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:51.257767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842686e3-4ca4-40a9-a145-868240af347d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:51.268871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842686e3-4ca4-40a9-a145-868240af347d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.274154 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f0f1-db30-4a62-acc6-2019ef5baf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.274867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f0f1-db30-4a62-acc6-2019ef5baf15 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.275188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f0f1-db30-4a62-acc6-2019ef5baf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.275455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446f0f1-db30-4a62-acc6-2019ef5baf15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.276015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446f0f1-db30-4a62-acc6-2019ef5baf15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:51.278117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446f0f1-db30-4a62-acc6-2019ef5baf15 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:51.312260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 935/1837] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:50 2022] PUT /identity/v3/projects/088fd6983e9244e284abfbb236a41b70/users/a911c208854645ed9aa0752a039a408a/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:51.367614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2bac-0e75-4adc-95a7-c2d9815164ad admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:51.369480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a95c2bac-0e75-4adc-95a7-c2d9815164ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:51.437089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2bac-0e75-4adc-95a7-c2d9815164ad admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.441872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fd3d7-3b4a-403b-b41c-53c6c9f75d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.442689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fd3d7-3b4a-403b-b41c-53c6c9f75d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.442823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fd3d7-3b4a-403b-b41c-53c6c9f75d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.443056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fd3d7-3b4a-403b-b41c-53c6c9f75d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.443818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fd3d7-3b4a-403b-b41c-53c6c9f75d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:51.445535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fd3d7-3b4a-403b-b41c-53c6c9f75d2a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:51.456235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 936/1838] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:01:51.460064 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fd3d7-3b4a-403b-b41c-53c6c9f75d2a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:51.469616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fd3d7-3b4a-403b-b41c-53c6c9f75d2a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.474814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87f421-de75-4d7f-b0e0-733e1fd48a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.475459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f421-de75-4d7f-b0e0-733e1fd48a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.475740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f421-de75-4d7f-b0e0-733e1fd48a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.476013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f421-de75-4d7f-b0e0-733e1fd48a25 admin admin] PATH_INFO: `/v3/projects/088fd6983e9244e284abfbb236a41b70/users/a911c208854645ed9aa0752a039a408a/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.477926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87f421-de75-4d7f-b0e0-733e1fd48a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088fd6983e9244e284abfbb236a41b70, user_id=a911c208854645ed9aa0752a039a408a, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:51.480576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87f421-de75-4d7f-b0e0-733e1fd48a25 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:51.504027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 937/1839] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:51 2022] PUT /identity/v3/projects/088fd6983e9244e284abfbb236a41b70/users/a911c208854645ed9aa0752a039a408a/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:01:51.507354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0703b9-d333-42c9-8e5b-25dee038d508 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.507648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0703b9-d333-42c9-8e5b-25dee038d508 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.507926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0703b9-d333-42c9-8e5b-25dee038d508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.547830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0c0703b9-d333-42c9-8e5b-25dee038d508 None None] MFA Rules not processed for user `a911c208854645ed9aa0752a039a408a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:51.549673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c0703b9-d333-42c9-8e5b-25dee038d508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:51.652817 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 903/1840] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:51 2022] POST /identity/v3/projects => generated 377 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:51.653992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f0f1-db30-4a62-acc6-2019ef5baf15 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:51.685886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 938/1841] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:51 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:01:51.717962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0703b9-d333-42c9-8e5b-25dee038d508 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:51.718611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c0703b9-d333-42c9-8e5b-25dee038d508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:51.751444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446f0f1-db30-4a62-acc6-2019ef5baf15 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.758816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6eb8f-a651-4fa7-a279-ea0f260fc59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.759493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6eb8f-a651-4fa7-a279-ea0f260fc59c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.760039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6eb8f-a651-4fa7-a279-ea0f260fc59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.760338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6eb8f-a651-4fa7-a279-ea0f260fc59c admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.760992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6eb8f-a651-4fa7-a279-ea0f260fc59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:51.763837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6eb8f-a651-4fa7-a279-ea0f260fc59c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:51.790828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0703b9-d333-42c9-8e5b-25dee038d508 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.833426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7a2e-2803-48ee-abed-1f56dbbc4abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.834055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7a2e-2803-48ee-abed-1f56dbbc4abf service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.834473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7a2e-2803-48ee-abed-1f56dbbc4abf service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.834751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7a2e-2803-48ee-abed-1f56dbbc4abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.901460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7a2e-2803-48ee-abed-1f56dbbc4abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:51.902505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 904/1842] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:51 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:51.902957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7a2e-2803-48ee-abed-1f56dbbc4abf service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:51.906383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6eb8f-a651-4fa7-a279-ea0f260fc59c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:51.913570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 939/1843] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:51 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:01:51.916644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6eb8f-a651-4fa7-a279-ea0f260fc59c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.921409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d2a7e-c99b-4658-bcfb-5a5193ceea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.922118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d2a7e-c99b-4658-bcfb-5a5193ceea10 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.922464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d2a7e-c99b-4658-bcfb-5a5193ceea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.923423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d2a7e-c99b-4658-bcfb-5a5193ceea10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.924157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d2a7e-c99b-4658-bcfb-5a5193ceea10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:51.925896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d2a7e-c99b-4658-bcfb-5a5193ceea10 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:51.936663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 905/1844] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:51.940619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7a2e-2803-48ee-abed-1f56dbbc4abf service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:51.951041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7a2e-2803-48ee-abed-1f56dbbc4abf service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.955770 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6a71-6634-4c2a-be65-aa31637c2693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.956376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6a71-6634-4c2a-be65-aa31637c2693 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.956663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6a71-6634-4c2a-be65-aa31637c2693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.956944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6a71-6634-4c2a-be65-aa31637c2693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:51.957603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f6a71-6634-4c2a-be65-aa31637c2693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:51.959252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f6a71-6634-4c2a-be65-aa31637c2693 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:51.968899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 940/1845] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:51.973717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d2a7e-c99b-4658-bcfb-5a5193ceea10 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:51.984292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d2a7e-c99b-4658-bcfb-5a5193ceea10 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:51.992380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d25fa-cce1-4ae8-96b7-539b6ce132a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:51.992380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d25fa-cce1-4ae8-96b7-539b6ce132a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:51.992380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d25fa-cce1-4ae8-96b7-539b6ce132a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:51.992380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d25fa-cce1-4ae8-96b7-539b6ce132a1 admin admin] PATH_INFO: `/v3/projects/7ff3ae96c2d748118a64f20d3b55f019/users/e0e5ec968b904496b0a38f1ecda48def/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:52.006984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d25fa-cce1-4ae8-96b7-539b6ce132a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff3ae96c2d748118a64f20d3b55f019, user_id=e0e5ec968b904496b0a38f1ecda48def, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:52.010037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d25fa-cce1-4ae8-96b7-539b6ce132a1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:52.125267 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 906/1846] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:51 2022] PUT /identity/v3/projects/7ff3ae96c2d748118a64f20d3b55f019/users/e0e5ec968b904496b0a38f1ecda48def/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:52.136408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12447b69-a1f4-4819-a009-246c7f80673f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:52.136727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12447b69-a1f4-4819-a009-246c7f80673f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:52.137017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12447b69-a1f4-4819-a009-246c7f80673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:52.144123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:52.166494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d25fa-cce1-4ae8-96b7-539b6ce132a1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:52.168370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aa8d25fa-cce1-4ae8-96b7-539b6ce132a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:52.170899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-12447b69-a1f4-4819-a009-246c7f80673f None None] MFA Rules not processed for user `e0e5ec968b904496b0a38f1ecda48def`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:52.172124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12447b69-a1f4-4819-a009-246c7f80673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:52.225482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d25fa-cce1-4ae8-96b7-539b6ce132a1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:52.229187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7fa4-00df-421a-8b14-a38ff41d0fc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:52.229793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7fa4-00df-421a-8b14-a38ff41d0fc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:52.230072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7fa4-00df-421a-8b14-a38ff41d0fc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:52.230374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7fa4-00df-421a-8b14-a38ff41d0fc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:52.232178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8c3b7fa4-00df-421a-8b14-a38ff41d0fc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:52.235762 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 941/1847] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:01:52.237251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12447b69-a1f4-4819-a009-246c7f80673f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:52.248534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12447b69-a1f4-4819-a009-246c7f80673f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:52.252349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfb1a7-38dc-4695-a47a-0b46a61b9ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:52.253321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfb1a7-38dc-4695-a47a-0b46a61b9ddc service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:52.253610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfb1a7-38dc-4695-a47a-0b46a61b9ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:52.253891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfb1a7-38dc-4695-a47a-0b46a61b9ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:52.255668 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14bfb1a7-38dc-4695-a47a-0b46a61b9ddc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:52.297089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b7fa4-00df-421a-8b14-a38ff41d0fc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:52.298721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b7fa4-00df-421a-8b14-a38ff41d0fc8 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:52.311225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 907/1848] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:52.311225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7fa4-00df-421a-8b14-a38ff41d0fc8 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:52.318671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfb1a7-38dc-4695-a47a-0b46a61b9ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:52.320321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfb1a7-38dc-4695-a47a-0b46a61b9ddc service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:52.332569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:52.346641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 942/1849] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:52 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:52.401795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7fa4-00df-421a-8b14-a38ff41d0fc8 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:52.409890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c79fec-a8d2-4a75-9a09-2d7c50c315f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:52.410680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c79fec-a8d2-4a75-9a09-2d7c50c315f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:52.411203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c79fec-a8d2-4a75-9a09-2d7c50c315f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:52.411684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c79fec-a8d2-4a75-9a09-2d7c50c315f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:52.412442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c79fec-a8d2-4a75-9a09-2d7c50c315f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:52.414580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c79fec-a8d2-4a75-9a09-2d7c50c315f3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:52.507696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 908/1850] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:52 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:52.511720 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfb1a7-38dc-4695-a47a-0b46a61b9ddc service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:52.523263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfb1a7-38dc-4695-a47a-0b46a61b9ddc service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:52.579903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede8ce-1496-489e-ac56-a865da0487b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:52.580544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede8ce-1496-489e-ac56-a865da0487b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:52.580802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede8ce-1496-489e-ac56-a865da0487b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:52.581081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eede8ce-1496-489e-ac56-a865da0487b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:52.582056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eede8ce-1496-489e-ac56-a865da0487b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:52.583670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eede8ce-1496-489e-ac56-a865da0487b8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:52.728014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 943/1851] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:52 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:52.732101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c79fec-a8d2-4a75-9a09-2d7c50c315f3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:52.743204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c79fec-a8d2-4a75-9a09-2d7c50c315f3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:52.747956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352d319-f611-46a4-a09e-431a025aad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:52.748623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d319-f611-46a4-a09e-431a025aad63 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:52.748898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d319-f611-46a4-a09e-431a025aad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:52.749175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352d319-f611-46a4-a09e-431a025aad63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:52.749857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352d319-f611-46a4-a09e-431a025aad63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:52.752003 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352d319-f611-46a4-a09e-431a025aad63 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:52.762842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 909/1852] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:01:52.767587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede8ce-1496-489e-ac56-a865da0487b8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:52.788853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eede8ce-1496-489e-ac56-a865da0487b8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:52.795987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec0b2-04d3-4a2a-81fb-4b81d9bd47c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:52.796663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec0b2-04d3-4a2a-81fb-4b81d9bd47c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:52.796947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec0b2-04d3-4a2a-81fb-4b81d9bd47c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:52.797277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ec0b2-04d3-4a2a-81fb-4b81d9bd47c7 admin admin] PATH_INFO: `/v3/projects/5139b30cafb5402eae0910e77e61339f/users/b98de42a6b744d1aa263fb8ee5597ac5/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:52.820472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ec0b2-04d3-4a2a-81fb-4b81d9bd47c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5139b30cafb5402eae0910e77e61339f, user_id=b98de42a6b744d1aa263fb8ee5597ac5, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:52.823218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ec0b2-04d3-4a2a-81fb-4b81d9bd47c7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:52.948982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 944/1853] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:52 2022] PUT /identity/v3/projects/5139b30cafb5402eae0910e77e61339f/users/b98de42a6b744d1aa263fb8ee5597ac5/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:52.952774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352d319-f611-46a4-a09e-431a025aad63 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:52.962564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352d319-f611-46a4-a09e-431a025aad63 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:53.017277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64143c-758e-4eea-ac76-bee9f3b98aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:53.017893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64143c-758e-4eea-ac76-bee9f3b98aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:53.018208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64143c-758e-4eea-ac76-bee9f3b98aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:53.018488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64143c-758e-4eea-ac76-bee9f3b98aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:53.019131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64143c-758e-4eea-ac76-bee9f3b98aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:53.020905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64143c-758e-4eea-ac76-bee9f3b98aa3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:53.033261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 910/1854] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:01:53.034441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec0b2-04d3-4a2a-81fb-4b81d9bd47c7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:53.046784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ec0b2-04d3-4a2a-81fb-4b81d9bd47c7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:53.052872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c78c3-8678-470f-9240-94e56e7888dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:53.053640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c78c3-8678-470f-9240-94e56e7888dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:53.053995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c78c3-8678-470f-9240-94e56e7888dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:53.054376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c78c3-8678-470f-9240-94e56e7888dc admin admin] PATH_INFO: `/v3/projects/5139b30cafb5402eae0910e77e61339f/users/b98de42a6b744d1aa263fb8ee5597ac5/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:53.064389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c78c3-8678-470f-9240-94e56e7888dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5139b30cafb5402eae0910e77e61339f, user_id=b98de42a6b744d1aa263fb8ee5597ac5, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:53.064389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c78c3-8678-470f-9240-94e56e7888dc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:53.072599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 945/1855] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:53 2022] PUT /identity/v3/projects/5139b30cafb5402eae0910e77e61339f/users/b98de42a6b744d1aa263fb8ee5597ac5/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:53.082866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff41bf2-a604-46ff-b56c-63032755d50c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:53.083153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff41bf2-a604-46ff-b56c-63032755d50c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:53.083428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff41bf2-a604-46ff-b56c-63032755d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:53.110920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7ff41bf2-a604-46ff-b56c-63032755d50c None None] MFA Rules not processed for user `b98de42a6b744d1aa263fb8ee5597ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:53.112153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7ff41bf2-a604-46ff-b56c-63032755d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:53.178962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 911/1856] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:01:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:53.227986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c78c3-8678-470f-9240-94e56e7888dc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:53.299930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c78c3-8678-470f-9240-94e56e7888dc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:53.305348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0429c-95f1-44c7-8aa7-c18a04868485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:53.305348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0429c-95f1-44c7-8aa7-c18a04868485 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:53.305348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0429c-95f1-44c7-8aa7-c18a04868485 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:53.305348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0429c-95f1-44c7-8aa7-c18a04868485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:53.359298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0429c-95f1-44c7-8aa7-c18a04868485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:53.361362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0429c-95f1-44c7-8aa7-c18a04868485 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:53.371332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 946/1857] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:53.904595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:54.423289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:55.175636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff41bf2-a604-46ff-b56c-63032755d50c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:55.187695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff41bf2-a604-46ff-b56c-63032755d50c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:55.192188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f113b-1393-4992-a955-508e79d77131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:55.192816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f113b-1393-4992-a955-508e79d77131 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:55.193166 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f113b-1393-4992-a955-508e79d77131 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:55.193514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f113b-1393-4992-a955-508e79d77131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:55.206933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f113b-1393-4992-a955-508e79d77131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:55.208755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f113b-1393-4992-a955-508e79d77131 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:55.221467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 912/1858] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:55.571302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:55.770314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:56.628254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:57.873688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:58.374499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561565ed-a69a-42a5-a5a7-e9c36e894b20 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:58.375021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561565ed-a69a-42a5-a5a7-e9c36e894b20 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:58.375488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561565ed-a69a-42a5-a5a7-e9c36e894b20 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:58.377277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 947/1859] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:01:58.398674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba750f8-cd09-4a8e-9287-557682a478e8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:58.398674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba750f8-cd09-4a8e-9287-557682a478e8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:58.398674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba750f8-cd09-4a8e-9287-557682a478e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:58.449649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9ba750f8-cd09-4a8e-9287-557682a478e8 None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:58.452453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9ba750f8-cd09-4a8e-9287-557682a478e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:58.625538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 913/1860] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:01:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:58.638378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561565ed-a69a-42a5-a5a7-e9c36e894b20 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:58.640172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-561565ed-a69a-42a5-a5a7-e9c36e894b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:58.659378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561565ed-a69a-42a5-a5a7-e9c36e894b20 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:58.667576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e719-2963-47e1-bc9e-e233872a3419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:58.667576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e719-2963-47e1-bc9e-e233872a3419 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:58.667576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e719-2963-47e1-bc9e-e233872a3419 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:58.669738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691e719-2963-47e1-bc9e-e233872a3419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:58.677589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691e719-2963-47e1-bc9e-e233872a3419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:58.679320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691e719-2963-47e1-bc9e-e233872a3419 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:58.702184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 948/1861] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:58.896605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:59.176415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:59.468454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:59.868070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba750f8-cd09-4a8e-9287-557682a478e8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:59.971108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba750f8-cd09-4a8e-9287-557682a478e8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:59.976249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:59.977178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:59.977805 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:59.978364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] PATH_INFO: `/v3/users/1fe5466ce57648eeaaf674103a6d71a1` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:59.980305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe5466ce57648eeaaf674103a6d71a1)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:59.982334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:59.985479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:00.027554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e719-2963-47e1-bc9e-e233872a3419 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:00.045582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691e719-2963-47e1-bc9e-e233872a3419 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:00.050512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154ddec-b1d9-4ae3-8fda-298b2b384f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:00.051424 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ddec-b1d9-4ae3-8fda-298b2b384f66 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:00.052034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ddec-b1d9-4ae3-8fda-298b2b384f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:00.052510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ddec-b1d9-4ae3-8fda-298b2b384f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:00.055422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8154ddec-b1d9-4ae3-8fda-298b2b384f66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:00.075549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:00.152420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154ddec-b1d9-4ae3-8fda-298b2b384f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:00.159583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154ddec-b1d9-4ae3-8fda-298b2b384f66 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:00.167552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe5466ce57648eeaaf674103a6d71a1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:00.168290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe5466ce57648eeaaf674103a6d71a1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:00.170375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 949/1862] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:00.185883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe5466ce57648eeaaf674103a6d71a1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:00.186820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe5466ce57648eeaaf674103a6d71a1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:00.212641 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe5466ce57648eeaaf674103a6d71a1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:00.278679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 914/1863] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:59 2022] DELETE /identity/v3/users/1fe5466ce57648eeaaf674103a6d71a1 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:00.283129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae4e3-f0ea-4ca0-903a-15f8001fe656 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:00.283421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae4e3-f0ea-4ca0-903a-15f8001fe656 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:00.283695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae4e3-f0ea-4ca0-903a-15f8001fe656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:00.302417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cdaae4e3-f0ea-4ca0-903a-15f8001fe656 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:00.303621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cdaae4e3-f0ea-4ca0-903a-15f8001fe656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:00.362806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 950/1864] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:00.372680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:00.374198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:00.435222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21654a9-0015-43e6-a177-058687f4b303 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:00.439563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748970ad-2791-4f12-9d41-72081fb61321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:00.440171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748970ad-2791-4f12-9d41-72081fb61321 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:00.440453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748970ad-2791-4f12-9d41-72081fb61321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:00.440723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748970ad-2791-4f12-9d41-72081fb61321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:00.449722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748970ad-2791-4f12-9d41-72081fb61321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:00.451222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748970ad-2791-4f12-9d41-72081fb61321 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:00.460629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 915/1865] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:00.577093 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:00.664086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:00.842849 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaae4e3-f0ea-4ca0-903a-15f8001fe656 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:00.844807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cdaae4e3-f0ea-4ca0-903a-15f8001fe656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:00.871645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaae4e3-f0ea-4ca0-903a-15f8001fe656 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:00.875658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:00.875658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:00.884946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:00.885294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] PATH_INFO: `/v3/projects/57ec4440c7ae4dd38317d5ad1403ac98` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:00.886862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ec4440c7ae4dd38317d5ad1403ac98)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:00.889145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:01.036063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ec4440c7ae4dd38317d5ad1403ac98', 'request_id': 'req-aee81e23-adfd-450a-b01d-d0fecdc1b382'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.042633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ec4440c7ae4dd38317d5ad1403ac98', 'request_id': 'req-aee81e23-adfd-450a-b01d-d0fecdc1b382'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.096605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ec4440c7ae4dd38317d5ad1403ac98', 'request_id': 'req-aee81e23-adfd-450a-b01d-d0fecdc1b382'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.109713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] The token cache is being invalidate because project 57ec4440c7ae4dd38317d5ad1403ac98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:01.110059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.111502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.116486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 951/1866] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:00 2022] DELETE /identity/v3/projects/57ec4440c7ae4dd38317d5ad1403ac98 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:01.117452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748970ad-2791-4f12-9d41-72081fb61321 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:01.129923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748970ad-2791-4f12-9d41-72081fb61321 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:01.214707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:01.215474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:01.215852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:01.216226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] PATH_INFO: `/v3/users/a911c208854645ed9aa0752a039a408a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:01.217563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a911c208854645ed9aa0752a039a408a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:01.221196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:01.487925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a911c208854645ed9aa0752a039a408a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.489054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a911c208854645ed9aa0752a039a408a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.496752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a911c208854645ed9aa0752a039a408a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.497548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a911c208854645ed9aa0752a039a408a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.503806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:01.505316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:01.511396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4e04ef32-9714-4aeb-bf1c-e107e51d64d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a911c208854645ed9aa0752a039a408a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.525836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee81e23-adfd-450a-b01d-d0fecdc1b382 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:01.530973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:01.531397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:01.531677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:01.531951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] PATH_INFO: `/v3/users/e0e5ec968b904496b0a38f1ecda48def` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:01.533113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e5ec968b904496b0a38f1ecda48def)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:01.535380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:01.549675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:01.589286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 916/1867] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:01 2022] DELETE /identity/v3/users/a911c208854645ed9aa0752a039a408a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:01.773972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e5ec968b904496b0a38f1ecda48def'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.774734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e5ec968b904496b0a38f1ecda48def'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.783815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e5ec968b904496b0a38f1ecda48def'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.873537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e5ec968b904496b0a38f1ecda48def'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.877580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e5ec968b904496b0a38f1ecda48def'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:01.881546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:01.894995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 952/1868] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:01 2022] DELETE /identity/v3/users/e0e5ec968b904496b0a38f1ecda48def => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:01.899359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77bc38-b089-44cb-9c6e-e65654ccffd6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:01.899648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77bc38-b089-44cb-9c6e-e65654ccffd6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:01.899922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77bc38-b089-44cb-9c6e-e65654ccffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:01.933944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ff77bc38-b089-44cb-9c6e-e65654ccffd6 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:01.936339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ff77bc38-b089-44cb-9c6e-e65654ccffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:02.023106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 917/1869] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:02.035672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:02.037320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77bc38-b089-44cb-9c6e-e65654ccffd6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:02.037438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:02.038987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ff77bc38-b089-44cb-9c6e-e65654ccffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:02.051972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77bc38-b089-44cb-9c6e-e65654ccffd6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:02.058773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:02.060736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:02.060736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:02.060736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] PATH_INFO: `/v3/projects/088fd6983e9244e284abfbb236a41b70` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:02.062322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=088fd6983e9244e284abfbb236a41b70)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:02.064382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:02.129384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd16f7-e0c7-4beb-8c0b-862a0beb6575 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:02.139608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c200-708d-4ef7-840d-6083c9f731e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:02.141123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c200-708d-4ef7-840d-6083c9f731e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:02.141727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c200-708d-4ef7-840d-6083c9f731e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:02.142795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c200-708d-4ef7-840d-6083c9f731e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:02.161939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4c200-708d-4ef7-840d-6083c9f731e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:02.167149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4c200-708d-4ef7-840d-6083c9f731e6 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:02.179467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 953/1870] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:02.187064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088fd6983e9244e284abfbb236a41b70', 'request_id': 'req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:02.201485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088fd6983e9244e284abfbb236a41b70', 'request_id': 'req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:02.209343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088fd6983e9244e284abfbb236a41b70', 'request_id': 'req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:02.338196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] The token cache is being invalidate because project 088fd6983e9244e284abfbb236a41b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:02.338196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:02.338196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f1ff6c1d-0c31-4a6b-867f-8c27c7fa89fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:02.339725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 918/1871] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:02 2022] DELETE /identity/v3/projects/088fd6983e9244e284abfbb236a41b70 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:02.345054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe9b40-2bd3-4423-a64a-4884260743b7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:02.345355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe9b40-2bd3-4423-a64a-4884260743b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:02.345659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe9b40-2bd3-4423-a64a-4884260743b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:02.370733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7dfe9b40-2bd3-4423-a64a-4884260743b7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:02.372458 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7dfe9b40-2bd3-4423-a64a-4884260743b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:02.467724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b18f6-4c65-425c-932d-6d78e6c5c25f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:02.468147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b18f6-4c65-425c-932d-6d78e6c5c25f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:02.468492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b18f6-4c65-425c-932d-6d78e6c5c25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:02.479429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 954/1872] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:02.511011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b02b18f6-4c65-425c-932d-6d78e6c5c25f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:02.512471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b02b18f6-4c65-425c-932d-6d78e6c5c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:02.534527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 919/1873] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:02.536779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe9b40-2bd3-4423-a64a-4884260743b7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:02.539446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:02.552757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe9b40-2bd3-4423-a64a-4884260743b7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:02.567480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fc27a-7ac1-4557-b5ac-c5d964d9af39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:02.568657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fc27a-7ac1-4557-b5ac-c5d964d9af39 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:02.569143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fc27a-7ac1-4557-b5ac-c5d964d9af39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:02.571565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fc27a-7ac1-4557-b5ac-c5d964d9af39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:02.572444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fc27a-7ac1-4557-b5ac-c5d964d9af39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:02.573110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fc27a-7ac1-4557-b5ac-c5d964d9af39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:02.580361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fc27a-7ac1-4557-b5ac-c5d964d9af39 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:02.606707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 955/1874] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 09:02:02.609699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b18f6-4c65-425c-932d-6d78e6c5c25f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:02.623648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b18f6-4c65-425c-932d-6d78e6c5c25f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:02.630719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fa2ae-208a-4cbf-a071-ffd449174109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:02.636724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fa2ae-208a-4cbf-a071-ffd449174109 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:02.636724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fa2ae-208a-4cbf-a071-ffd449174109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:02.636724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1fa2ae-208a-4cbf-a071-ffd449174109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:02.636724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fa2ae-208a-4cbf-a071-ffd449174109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:02.636724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1fa2ae-208a-4cbf-a071-ffd449174109 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:02.761481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 920/1875] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:02 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:02.765899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fc27a-7ac1-4557-b5ac-c5d964d9af39 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:02.780990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fc27a-7ac1-4557-b5ac-c5d964d9af39 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:02.854675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c3bb4-42eb-40f6-8226-4aa8dd3435ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:02.855219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c3bb4-42eb-40f6-8226-4aa8dd3435ca admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:02.855503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c3bb4-42eb-40f6-8226-4aa8dd3435ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:02.855781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c3bb4-42eb-40f6-8226-4aa8dd3435ca admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:02.856537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c3bb4-42eb-40f6-8226-4aa8dd3435ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:02.858547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c3bb4-42eb-40f6-8226-4aa8dd3435ca admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:02.949883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 956/1876] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:02 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:02.951165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fa2ae-208a-4cbf-a071-ffd449174109 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:02.953330 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eb1fa2ae-208a-4cbf-a071-ffd449174109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:02.957270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c3bb4-42eb-40f6-8226-4aa8dd3435ca admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:02.971989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c3bb4-42eb-40f6-8226-4aa8dd3435ca admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:02.978486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807e2a-92c8-4141-8765-4b2dcd2e1f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:02.979045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1fa2ae-208a-4cbf-a071-ffd449174109 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:02.979175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807e2a-92c8-4141-8765-4b2dcd2e1f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:02.979829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807e2a-92c8-4141-8765-4b2dcd2e1f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:02.980106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26807e2a-92c8-4141-8765-4b2dcd2e1f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:02.981375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26807e2a-92c8-4141-8765-4b2dcd2e1f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:02.983498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26807e2a-92c8-4141-8765-4b2dcd2e1f26 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:02.984542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:02.985279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:02.986525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:02.986683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] PATH_INFO: `/v3/projects/7ff3ae96c2d748118a64f20d3b55f019` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:02.986766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:02.988922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff3ae96c2d748118a64f20d3b55f019)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:02.999819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 957/1877] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:03.003313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807e2a-92c8-4141-8765-4b2dcd2e1f26 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:03.007707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:03.014583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26807e2a-92c8-4141-8765-4b2dcd2e1f26 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:03.020594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e823a5f-c723-4a8f-83a8-72e56786bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:03.037056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e823a5f-c723-4a8f-83a8-72e56786bcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:03.037056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e823a5f-c723-4a8f-83a8-72e56786bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:03.037056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e823a5f-c723-4a8f-83a8-72e56786bcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:03.037056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e823a5f-c723-4a8f-83a8-72e56786bcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:03.037056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e823a5f-c723-4a8f-83a8-72e56786bcd3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:03.040723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 958/1878] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:03.045062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e823a5f-c723-4a8f-83a8-72e56786bcd3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:03.064780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e823a5f-c723-4a8f-83a8-72e56786bcd3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:03.070132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a09fc-d88f-45ae-a42c-b92449aa9052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:03.070986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a09fc-d88f-45ae-a42c-b92449aa9052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:03.071274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a09fc-d88f-45ae-a42c-b92449aa9052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:03.071582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a09fc-d88f-45ae-a42c-b92449aa9052 admin admin] PATH_INFO: `/v3/projects/3dcb57951821450aa05d433659dde16d/users/c1b2fa1ad837485e8485417c986fcf0f/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:03.087207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a09fc-d88f-45ae-a42c-b92449aa9052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcb57951821450aa05d433659dde16d, user_id=c1b2fa1ad837485e8485417c986fcf0f, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:03.089970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a09fc-d88f-45ae-a42c-b92449aa9052 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:03.213044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 959/1879] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:03 2022] PUT /identity/v3/projects/3dcb57951821450aa05d433659dde16d/users/c1b2fa1ad837485e8485417c986fcf0f/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:03.219457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff3ae96c2d748118a64f20d3b55f019', 'request_id': 'req-0c846643-6419-431e-b577-b2997b22e007'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.228417 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff3ae96c2d748118a64f20d3b55f019', 'request_id': 'req-0c846643-6419-431e-b577-b2997b22e007'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.235017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaee710-a23f-4c8a-9e88-9752e0569233 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:03.235390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaee710-a23f-4c8a-9e88-9752e0569233 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:03.236579 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaee710-a23f-4c8a-9e88-9752e0569233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:03.237761 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff3ae96c2d748118a64f20d3b55f019', 'request_id': 'req-0c846643-6419-431e-b577-b2997b22e007'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.258228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-feaee710-a23f-4c8a-9e88-9752e0569233 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:03.265158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-feaee710-a23f-4c8a-9e88-9752e0569233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:03.326434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 960/1880] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:03.337809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaee710-a23f-4c8a-9e88-9752e0569233 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:03.339285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-feaee710-a23f-4c8a-9e88-9752e0569233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:03.353662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] The token cache is being invalidate because project 7ff3ae96c2d748118a64f20d3b55f019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:03.353965 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.354700 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.356300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 921/1881] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:02 2022] DELETE /identity/v3/projects/7ff3ae96c2d748118a64f20d3b55f019 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:03.360421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:03.362449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:03.409796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaee710-a23f-4c8a-9e88-9752e0569233 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:03.413440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9e6e5-092e-4a60-93fc-7106213e40a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:03.414055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9e6e5-092e-4a60-93fc-7106213e40a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:03.414368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9e6e5-092e-4a60-93fc-7106213e40a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:03.414678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9e6e5-092e-4a60-93fc-7106213e40a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:03.416436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-85b9e6e5-092e-4a60-93fc-7106213e40a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:03.437785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9e6e5-092e-4a60-93fc-7106213e40a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:03.439355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9e6e5-092e-4a60-93fc-7106213e40a4 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:03.452554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c846643-6419-431e-b577-b2997b22e007 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:03.460564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:03.461227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:03.461650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:03.461924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] PATH_INFO: `/v3/users/b98de42a6b744d1aa263fb8ee5597ac5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:03.463429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98de42a6b744d1aa263fb8ee5597ac5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:03.464452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 961/1882] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:03.465426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:03.712868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98de42a6b744d1aa263fb8ee5597ac5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.713552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98de42a6b744d1aa263fb8ee5597ac5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.721602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98de42a6b744d1aa263fb8ee5597ac5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.722738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98de42a6b744d1aa263fb8ee5597ac5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.739512 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98de42a6b744d1aa263fb8ee5597ac5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:03.846116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 922/1883] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:03 2022] DELETE /identity/v3/users/b98de42a6b744d1aa263fb8ee5597ac5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:04.353122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:04.436282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9e6e5-092e-4a60-93fc-7106213e40a4 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:04.453758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9e6e5-092e-4a60-93fc-7106213e40a4 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:04.555087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:04.555909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:04.556337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:04.556754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] PATH_INFO: `/v3/projects/5139b30cafb5402eae0910e77e61339f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:04.558475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5139b30cafb5402eae0910e77e61339f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:04.560576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:04.596500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:04.597977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:04.619938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acd7c9-a1a9-466b-bcd2-4aa2ba7ce4d3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:04.629432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:04.630339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:04.630764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:04.631139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] PATH_INFO: `/v3/users/03cac518024f477da693e7a1ab39a912` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:04.632699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03cac518024f477da693e7a1ab39a912)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:04.636442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:04.718430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5139b30cafb5402eae0910e77e61339f', 'request_id': 'req-7f736ccf-2b75-4574-8db9-89a7ea5187d0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.727137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5139b30cafb5402eae0910e77e61339f', 'request_id': 'req-7f736ccf-2b75-4574-8db9-89a7ea5187d0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.810978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5139b30cafb5402eae0910e77e61339f', 'request_id': 'req-7f736ccf-2b75-4574-8db9-89a7ea5187d0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.836234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] The token cache is being invalidate because project 5139b30cafb5402eae0910e77e61339f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:04.836535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.837460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7f736ccf-2b75-4574-8db9-89a7ea5187d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.839105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 962/1884] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:04 2022] DELETE /identity/v3/projects/5139b30cafb5402eae0910e77e61339f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:04.844043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4152f1-a8f5-4dbb-b1b9-744203b6c5b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:04.844338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4152f1-a8f5-4dbb-b1b9-744203b6c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:04.845208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4152f1-a8f5-4dbb-b1b9-744203b6c5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:04.875803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fd4152f1-a8f5-4dbb-b1b9-744203b6c5b2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:04.877217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd4152f1-a8f5-4dbb-b1b9-744203b6c5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:04.937687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03cac518024f477da693e7a1ab39a912'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.938870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03cac518024f477da693e7a1ab39a912'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.950600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03cac518024f477da693e7a1ab39a912'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.951504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03cac518024f477da693e7a1ab39a912'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.970796 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-18ca81be-80b7-4ec4-b159-b4440c2fadc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03cac518024f477da693e7a1ab39a912'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:04.975367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 963/1885] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:04.985723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8122b-4f2f-4283-83df-39741175716d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:04.986390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8122b-4f2f-4283-83df-39741175716d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:04.986732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8122b-4f2f-4283-83df-39741175716d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.005967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:05.013569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cfa8122b-4f2f-4283-83df-39741175716d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:05.014990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cfa8122b-4f2f-4283-83df-39741175716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.028210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 964/1886] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:05.033008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8122b-4f2f-4283-83df-39741175716d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.044244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8122b-4f2f-4283-83df-39741175716d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.049584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82861-b2c2-473e-9c80-c1262d93c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.050315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82861-b2c2-473e-9c80-c1262d93c5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.050664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82861-b2c2-473e-9c80-c1262d93c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.051003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82861-b2c2-473e-9c80-c1262d93c5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.052154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82861-b2c2-473e-9c80-c1262d93c5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:05.052557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82861-b2c2-473e-9c80-c1262d93c5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.055025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82861-b2c2-473e-9c80-c1262d93c5f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.072882 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 965/1887] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 09:02:05.075764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82861-b2c2-473e-9c80-c1262d93c5f0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.084742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82861-b2c2-473e-9c80-c1262d93c5f0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.089998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549481a9-ddc8-4b80-a6b3-83f4c4da7659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.090739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549481a9-ddc8-4b80-a6b3-83f4c4da7659 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.091215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549481a9-ddc8-4b80-a6b3-83f4c4da7659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.091611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549481a9-ddc8-4b80-a6b3-83f4c4da7659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.092319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549481a9-ddc8-4b80-a6b3-83f4c4da7659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.094544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549481a9-ddc8-4b80-a6b3-83f4c4da7659 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.109719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 923/1888] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:04 2022] DELETE /identity/v3/users/03cac518024f477da693e7a1ab39a912 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:05.113547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837c1f-42f0-4d8d-9351-d47703a68b9f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.113902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837c1f-42f0-4d8d-9351-d47703a68b9f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.114276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1837c1f-42f0-4d8d-9351-d47703a68b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.156347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a1837c1f-42f0-4d8d-9351-d47703a68b9f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:05.162059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a1837c1f-42f0-4d8d-9351-d47703a68b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.242653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 924/1889] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:05.243480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1837c1f-42f0-4d8d-9351-d47703a68b9f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.244783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a1837c1f-42f0-4d8d-9351-d47703a68b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.251843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 966/1890] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:05 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:05.253035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549481a9-ddc8-4b80-a6b3-83f4c4da7659 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.260354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1837c1f-42f0-4d8d-9351-d47703a68b9f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.346163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.346972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.347417 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.347764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] PATH_INFO: `/v3/users/ffe0360cefb74802ad50abd002b654df` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.349057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe0360cefb74802ad50abd002b654df)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.350751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549481a9-ddc8-4b80-a6b3-83f4c4da7659 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.351556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.357493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bffc8e-5c04-4f6c-8d15-b8acfe7a48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.358467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bffc8e-5c04-4f6c-8d15-b8acfe7a48e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.358953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bffc8e-5c04-4f6c-8d15-b8acfe7a48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.359676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bffc8e-5c04-4f6c-8d15-b8acfe7a48e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.360684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bffc8e-5c04-4f6c-8d15-b8acfe7a48e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.363752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bffc8e-5c04-4f6c-8d15-b8acfe7a48e0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.492111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 967/1891] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:05 2022] POST /identity/v3/users => generated 284 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:05.493979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bffc8e-5c04-4f6c-8d15-b8acfe7a48e0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.495834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e3bffc8e-5c04-4f6c-8d15-b8acfe7a48e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.568485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe0360cefb74802ad50abd002b654df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.569999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe0360cefb74802ad50abd002b654df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.589831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe0360cefb74802ad50abd002b654df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.591307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe0360cefb74802ad50abd002b654df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.606731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bffc8e-5c04-4f6c-8d15-b8acfe7a48e0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.612158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.612894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.613172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.613445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.615869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.617283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe0360cefb74802ad50abd002b654df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.630020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.631577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.642069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 968/1892] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:05.643283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.644573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.656584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c7921-2469-420c-9e0c-58eb29ac7bd6 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.661348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d81df-5f88-48e8-b952-c054cc1269a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.661966 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d81df-5f88-48e8-b952-c054cc1269a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.662277 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d81df-5f88-48e8-b952-c054cc1269a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.662550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d81df-5f88-48e8-b952-c054cc1269a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.663256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d81df-5f88-48e8-b952-c054cc1269a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.664950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d81df-5f88-48e8-b952-c054cc1269a0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.677947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 969/1893] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:05.679578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11941fc-2814-411a-aa90-03159ef3dd98 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.679578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11941fc-2814-411a-aa90-03159ef3dd98 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.679753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11941fc-2814-411a-aa90-03159ef3dd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.691397 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 925/1894] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:05 2022] DELETE /identity/v3/users/ffe0360cefb74802ad50abd002b654df => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:05.692215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.710999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f11941fc-2814-411a-aa90-03159ef3dd98 None None] MFA Rules not processed for user `c1b2fa1ad837485e8485417c986fcf0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:05.712230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f11941fc-2814-411a-aa90-03159ef3dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.759920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802db72-8b4f-4129-9817-94a714d3d99b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.765218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cb1f4-0bb3-47d0-91c3-b5ea5347f7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.765846 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cb1f4-0bb3-47d0-91c3-b5ea5347f7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.766146 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cb1f4-0bb3-47d0-91c3-b5ea5347f7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.770037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cb1f4-0bb3-47d0-91c3-b5ea5347f7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.770037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cb1f4-0bb3-47d0-91c3-b5ea5347f7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.770037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cb1f4-0bb3-47d0-91c3-b5ea5347f7a2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.783085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 926/1895] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:05.783085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf4e08-5ea4-4383-9210-77316da8fffc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.783085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf4e08-5ea4-4383-9210-77316da8fffc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.783085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf4e08-5ea4-4383-9210-77316da8fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.787619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 970/1896] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:05.788716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11941fc-2814-411a-aa90-03159ef3dd98 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.800716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11941fc-2814-411a-aa90-03159ef3dd98 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.802203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d9bf4e08-5ea4-4383-9210-77316da8fffc None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:05.803411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d9bf4e08-5ea4-4383-9210-77316da8fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.805880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc500-1199-4714-a7af-eab69f911734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.806911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc500-1199-4714-a7af-eab69f911734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.807191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc500-1199-4714-a7af-eab69f911734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.807719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc500-1199-4714-a7af-eab69f911734 admin admin] PATH_INFO: `/v3/projects/c20317a162ef4dfb9874d600794158f8/users/5fbe1351b8824501aa268e317ca6b8e3/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.811633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 927/1897] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:05.812453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf4e08-5ea4-4383-9210-77316da8fffc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.814345 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d9bf4e08-5ea4-4383-9210-77316da8fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.828457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf4e08-5ea4-4383-9210-77316da8fffc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.829320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc500-1199-4714-a7af-eab69f911734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20317a162ef4dfb9874d600794158f8, user_id=5fbe1351b8824501aa268e317ca6b8e3, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.832205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc500-1199-4714-a7af-eab69f911734 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.836438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e27ce-5b9c-48b4-b34b-cbfab6c59d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.837158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e27ce-5b9c-48b4-b34b-cbfab6c59d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.837517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e27ce-5b9c-48b4-b34b-cbfab6c59d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.837853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e27ce-5b9c-48b4-b34b-cbfab6c59d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.838594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e27ce-5b9c-48b4-b34b-cbfab6c59d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.840552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e27ce-5b9c-48b4-b34b-cbfab6c59d89 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.896909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 971/1898] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:05 2022] PUT /identity/v3/projects/c20317a162ef4dfb9874d600794158f8/users/5fbe1351b8824501aa268e317ca6b8e3/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:05.897600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc500-1199-4714-a7af-eab69f911734 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.899297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-40fbc500-1199-4714-a7af-eab69f911734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.931998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 928/1899] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:05 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:05.933515 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579757-bf22-4cda-ba43-13dbce343b1e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.933800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579757-bf22-4cda-ba43-13dbce343b1e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.934130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe579757-bf22-4cda-ba43-13dbce343b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.000374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fe579757-bf22-4cda-ba43-13dbce343b1e None None] MFA Rules not processed for user `5fbe1351b8824501aa268e317ca6b8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:06.003754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fe579757-bf22-4cda-ba43-13dbce343b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:06.010339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc500-1199-4714-a7af-eab69f911734 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.097508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d35f-fa97-4079-97e7-fcdd458eb38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.098156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d35f-fa97-4079-97e7-fcdd458eb38e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.098439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d35f-fa97-4079-97e7-fcdd458eb38e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.098711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d35f-fa97-4079-97e7-fcdd458eb38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.106968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 929/1900] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:06.108220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe579757-bf22-4cda-ba43-13dbce343b1e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.163450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d35f-fa97-4079-97e7-fcdd458eb38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.164911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d35f-fa97-4079-97e7-fcdd458eb38e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.175769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 972/1901] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:06.176668 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d35f-fa97-4079-97e7-fcdd458eb38e service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.185402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe579757-bf22-4cda-ba43-13dbce343b1e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.186956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d35f-fa97-4079-97e7-fcdd458eb38e service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.193248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfe54b-3db4-4e6e-b963-6d0d4ed54de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.194135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33ce2a-d7f1-4706-9f11-57d2120d8e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.194440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe54b-3db4-4e6e-b963-6d0d4ed54de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.194946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe54b-3db4-4e6e-b963-6d0d4ed54de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.195078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33ce2a-d7f1-4706-9f11-57d2120d8e7c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.195407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33ce2a-d7f1-4706-9f11-57d2120d8e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.195768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe54b-3db4-4e6e-b963-6d0d4ed54de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.195890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33ce2a-d7f1-4706-9f11-57d2120d8e7c admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.196811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33ce2a-d7f1-4706-9f11-57d2120d8e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.197242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfe54b-3db4-4e6e-b963-6d0d4ed54de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.199441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfe54b-3db4-4e6e-b963-6d0d4ed54de5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.201070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33ce2a-d7f1-4706-9f11-57d2120d8e7c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.341853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:06.348357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 973/1902] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:06 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:06.352924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfe54b-3db4-4e6e-b963-6d0d4ed54de5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.354844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 930/1903] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:06 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:06.361807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33ce2a-d7f1-4706-9f11-57d2120d8e7c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.373396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33ce2a-d7f1-4706-9f11-57d2120d8e7c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.470484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5734e-a9be-4b44-ade7-210b232fb920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.471156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5734e-a9be-4b44-ade7-210b232fb920 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.475546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5734e-a9be-4b44-ade7-210b232fb920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.475546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5734e-a9be-4b44-ade7-210b232fb920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.475546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5734e-a9be-4b44-ade7-210b232fb920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.478605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5734e-a9be-4b44-ade7-210b232fb920 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.497347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfe54b-3db4-4e6e-b963-6d0d4ed54de5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.505652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 931/1904] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:06.510118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5734e-a9be-4b44-ade7-210b232fb920 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.512181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60d940-28c1-4d29-97a3-2c874d327db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.513609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60d940-28c1-4d29-97a3-2c874d327db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.514962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60d940-28c1-4d29-97a3-2c874d327db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.515441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60d940-28c1-4d29-97a3-2c874d327db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.517463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60d940-28c1-4d29-97a3-2c874d327db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.521913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60d940-28c1-4d29-97a3-2c874d327db1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.525354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:06.534638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5734e-a9be-4b44-ade7-210b232fb920 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.545403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a9b80-299e-43a9-a1ad-4aae74aa400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.545403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a9b80-299e-43a9-a1ad-4aae74aa400e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.545712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a9b80-299e-43a9-a1ad-4aae74aa400e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.545784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a9b80-299e-43a9-a1ad-4aae74aa400e admin admin] PATH_INFO: `/v3/projects/faf71b1146c642638286cb94308c99c8/users/f49f128f82d3459b83ee0cdea7437a49/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.570021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a9b80-299e-43a9-a1ad-4aae74aa400e admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf71b1146c642638286cb94308c99c8, user_id=f49f128f82d3459b83ee0cdea7437a49, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.575455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a9b80-299e-43a9-a1ad-4aae74aa400e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.634480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 974/1905] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:06 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:06.638545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60d940-28c1-4d29-97a3-2c874d327db1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.660082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60d940-28c1-4d29-97a3-2c874d327db1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.683516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d89e-2dc8-41b9-a74d-bdd5dfc91b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.683516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d89e-2dc8-41b9-a74d-bdd5dfc91b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.683516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d89e-2dc8-41b9-a74d-bdd5dfc91b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.683516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995d89e-2dc8-41b9-a74d-bdd5dfc91b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.683791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d89e-2dc8-41b9-a74d-bdd5dfc91b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.683791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995d89e-2dc8-41b9-a74d-bdd5dfc91b4c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.686397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 975/1906] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:06.691840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 932/1907] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:06 2022] PUT /identity/v3/projects/faf71b1146c642638286cb94308c99c8/users/f49f128f82d3459b83ee0cdea7437a49/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:06.693462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a9b80-299e-43a9-a1ad-4aae74aa400e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.696464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b65a9b80-299e-43a9-a1ad-4aae74aa400e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:06.700120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d89e-2dc8-41b9-a74d-bdd5dfc91b4c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.727622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995d89e-2dc8-41b9-a74d-bdd5dfc91b4c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.842964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d86c7d-e0b1-460e-a69a-d44a798e7a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.843921 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d86c7d-e0b1-460e-a69a-d44a798e7a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.844980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d86c7d-e0b1-460e-a69a-d44a798e7a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.845406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d86c7d-e0b1-460e-a69a-d44a798e7a4a admin admin] PATH_INFO: `/v3/projects/2c44f9984bad48adadb053f660cf6e4b/users/0b8b0b79ba1c4225af64468f49c6172c/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.848311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a9b80-299e-43a9-a1ad-4aae74aa400e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.853402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.854196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.854485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.854765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] PATH_INFO: `/v3/projects/8d90e18171c9454e8a04123e893c4a63` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.855925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d90e18171c9454e8a04123e893c4a63)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.858588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.865106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d86c7d-e0b1-460e-a69a-d44a798e7a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c44f9984bad48adadb053f660cf6e4b, user_id=0b8b0b79ba1c4225af64468f49c6172c, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.868245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d86c7d-e0b1-460e-a69a-d44a798e7a4a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.951499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 976/1908] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:06 2022] PUT /identity/v3/projects/2c44f9984bad48adadb053f660cf6e4b/users/0b8b0b79ba1c4225af64468f49c6172c/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:06.953030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d86c7d-e0b1-460e-a69a-d44a798e7a4a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.025002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d90e18171c9454e8a04123e893c4a63', 'request_id': 'req-a5522e59-96ab-4a95-a784-9355ce37fdf9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.032872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d86c7d-e0b1-460e-a69a-d44a798e7a4a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.050333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d90e18171c9454e8a04123e893c4a63', 'request_id': 'req-a5522e59-96ab-4a95-a784-9355ce37fdf9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.058647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d90e18171c9454e8a04123e893c4a63', 'request_id': 'req-a5522e59-96ab-4a95-a784-9355ce37fdf9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.107300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc2b7e-2b12-47d1-8540-8ceb593a1750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.108029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc2b7e-2b12-47d1-8540-8ceb593a1750 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.108367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc2b7e-2b12-47d1-8540-8ceb593a1750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.108651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc2b7e-2b12-47d1-8540-8ceb593a1750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.110836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc2b7e-2b12-47d1-8540-8ceb593a1750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.112702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc2b7e-2b12-47d1-8540-8ceb593a1750 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.130996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 977/1909] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:07.130996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc2b7e-2b12-47d1-8540-8ceb593a1750 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.134947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-31bc2b7e-2b12-47d1-8540-8ceb593a1750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.149673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc2b7e-2b12-47d1-8540-8ceb593a1750 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.154567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.155196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.155481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.155780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] PATH_INFO: `/v3/projects/f446c263a5224491a97620b575083228` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.156984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f446c263a5224491a97620b575083228)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.158961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.177707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] The token cache is being invalidate because project 8d90e18171c9454e8a04123e893c4a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:07.179546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.179546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.180861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 933/1910] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:06 2022] DELETE /identity/v3/projects/8d90e18171c9454e8a04123e893c4a63 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:07.184512 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.185984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.199327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5522e59-96ab-4a95-a784-9355ce37fdf9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.204565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acc28b-60f2-4bf0-ac55-673df0f7970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.207539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acc28b-60f2-4bf0-ac55-673df0f7970c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.207824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acc28b-60f2-4bf0-ac55-673df0f7970c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.208121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acc28b-60f2-4bf0-ac55-673df0f7970c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.208774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acc28b-60f2-4bf0-ac55-673df0f7970c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.210485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acc28b-60f2-4bf0-ac55-673df0f7970c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.221763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 934/1911] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:07.222617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acc28b-60f2-4bf0-ac55-673df0f7970c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.226496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-13acc28b-60f2-4bf0-ac55-673df0f7970c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.239927 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acc28b-60f2-4bf0-ac55-673df0f7970c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.244788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b695a-bfd8-45f8-9366-de690417369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.245443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b695a-bfd8-45f8-9366-de690417369d admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.245729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b695a-bfd8-45f8-9366-de690417369d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.246001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b695a-bfd8-45f8-9366-de690417369d admin admin] PATH_INFO: `/v3/projects/faf71b1146c642638286cb94308c99c8/users/f49f128f82d3459b83ee0cdea7437a49/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.248021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b695a-bfd8-45f8-9366-de690417369d admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf71b1146c642638286cb94308c99c8, user_id=f49f128f82d3459b83ee0cdea7437a49, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.250766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b695a-bfd8-45f8-9366-de690417369d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.265441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 935/1912] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:07 2022] PUT /identity/v3/projects/faf71b1146c642638286cb94308c99c8/users/f49f128f82d3459b83ee0cdea7437a49/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:07.269922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b695a-bfd8-45f8-9366-de690417369d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.271458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-571b695a-bfd8-45f8-9366-de690417369d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.276007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f446c263a5224491a97620b575083228', 'request_id': 'req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.286964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f446c263a5224491a97620b575083228', 'request_id': 'req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.357672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b695a-bfd8-45f8-9366-de690417369d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.399426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f446c263a5224491a97620b575083228', 'request_id': 'req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.442554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] The token cache is being invalidate because project f446c263a5224491a97620b575083228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:07.442864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.444126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.451391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 978/1913] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:07 2022] DELETE /identity/v3/projects/f446c263a5224491a97620b575083228 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:07.452281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.456744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.515820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.516574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.517455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.517749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] PATH_INFO: `/v3/users/30a8bcb4bcb449f69116764691abd9f2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.519798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a8bcb4bcb449f69116764691abd9f2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.524636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.597752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6de34-1f1f-4163-a3ae-6bc1bae3cd3a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.619139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30040d-926b-4798-af89-4b523dd42e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.620172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30040d-926b-4798-af89-4b523dd42e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.621108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30040d-926b-4798-af89-4b523dd42e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.621640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30040d-926b-4798-af89-4b523dd42e83 admin admin] PATH_INFO: `/v3/projects/2c44f9984bad48adadb053f660cf6e4b/users/0b8b0b79ba1c4225af64468f49c6172c/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.624251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30040d-926b-4798-af89-4b523dd42e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c44f9984bad48adadb053f660cf6e4b, user_id=0b8b0b79ba1c4225af64468f49c6172c, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.627155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30040d-926b-4798-af89-4b523dd42e83 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.641501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 979/1914] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:07 2022] PUT /identity/v3/projects/2c44f9984bad48adadb053f660cf6e4b/users/0b8b0b79ba1c4225af64468f49c6172c/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:07.642620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30040d-926b-4798-af89-4b523dd42e83 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.652429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9f30040d-926b-4798-af89-4b523dd42e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.746996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30040d-926b-4798-af89-4b523dd42e83 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.770670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.770670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.770670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.770670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] PATH_INFO: `/v3/users/9bc0bfb93f714cd88f445227c2881331` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.771264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc0bfb93f714cd88f445227c2881331)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.771264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.773987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a8bcb4bcb449f69116764691abd9f2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.775307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a8bcb4bcb449f69116764691abd9f2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.788983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a8bcb4bcb449f69116764691abd9f2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.789947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a8bcb4bcb449f69116764691abd9f2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.815412 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a1e467de-e1e5-44f1-bb41-d2b2cb146b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a8bcb4bcb449f69116764691abd9f2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.961382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 936/1915] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:07 2022] DELETE /identity/v3/users/30a8bcb4bcb449f69116764691abd9f2 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:07.976829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377460c4-41bc-4111-92b7-db42db983227 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.979380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377460c4-41bc-4111-92b7-db42db983227 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.979380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377460c4-41bc-4111-92b7-db42db983227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.997949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc0bfb93f714cd88f445227c2881331'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:08.000014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc0bfb93f714cd88f445227c2881331'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:08.033784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc0bfb93f714cd88f445227c2881331'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:08.066869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-377460c4-41bc-4111-92b7-db42db983227 None None] MFA Rules not processed for user `0b8b0b79ba1c4225af64468f49c6172c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:08.067308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-377460c4-41bc-4111-92b7-db42db983227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.186866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc0bfb93f714cd88f445227c2881331'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:08.187567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc0bfb93f714cd88f445227c2881331'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:08.200593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 937/1916] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:08.221039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 980/1917] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:07 2022] DELETE /identity/v3/users/9bc0bfb93f714cd88f445227c2881331 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:08.360453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377460c4-41bc-4111-92b7-db42db983227 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.362236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-377460c4-41bc-4111-92b7-db42db983227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.454696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377460c4-41bc-4111-92b7-db42db983227 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.525438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:08.531003 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.531818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.532358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.532694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.534956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.654665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:08.658755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.676782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 938/1918] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:08.738815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:08.861946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.863716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.924538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.942306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.957969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04463b-8821-4fc4-9abe-4fffe093e1f9 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.966228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.966862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.967150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.967513 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.972674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:09.010746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccb0c3-798c-461c-b09f-e234d798a334 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:09.020186 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:09.021126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.021587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.022070 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] PATH_INFO: `/v3/projects/7431a1c8e9f249eda90fc78c45ba9367` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.023658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7431a1c8e9f249eda90fc78c45ba9367)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:09.026409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:09.091137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:09.092490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:09.103120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 939/1919] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:09.103988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:09.105361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:09.120822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c381aa2-309a-41d2-8b65-d2ce2fa32485 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:09.125123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:09.125791 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.126555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.126841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] PATH_INFO: `/v3/projects/fe778bb779ae4a05a3ef15a18af69b11` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.128259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe778bb779ae4a05a3ef15a18af69b11)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:09.130760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:09.162697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7431a1c8e9f249eda90fc78c45ba9367', 'request_id': 'req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.169689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7431a1c8e9f249eda90fc78c45ba9367', 'request_id': 'req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.233369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7431a1c8e9f249eda90fc78c45ba9367', 'request_id': 'req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.248803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] The token cache is being invalidate because project 7431a1c8e9f249eda90fc78c45ba9367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:09.249356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.250326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.254952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 981/1920] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:08 2022] DELETE /identity/v3/projects/7431a1c8e9f249eda90fc78c45ba9367 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:09.256022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:09.258381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:09.262266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe778bb779ae4a05a3ef15a18af69b11', 'request_id': 'req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.270827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe778bb779ae4a05a3ef15a18af69b11', 'request_id': 'req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.278900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe778bb779ae4a05a3ef15a18af69b11', 'request_id': 'req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.337784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd9c2b-a81b-4913-8d8a-a3aee8664a7a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:09.414589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:09.415187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.415468 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.415740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] PATH_INFO: `/v3/users/870e3777744b4c7f8e5e648946c75248` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.416931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=870e3777744b4c7f8e5e648946c75248)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:09.419590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:09.460748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] The token cache is being invalidate because project fe778bb779ae4a05a3ef15a18af69b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:09.460748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.460748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-db55f5f5-daee-4fc1-bc9f-39929ceae2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.471396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 940/1921] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:09 2022] DELETE /identity/v3/projects/fe778bb779ae4a05a3ef15a18af69b11 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:09.471396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1c926-16c0-4373-93fe-dedd98fd3615 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.471396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1c926-16c0-4373-93fe-dedd98fd3615 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.471396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1c926-16c0-4373-93fe-dedd98fd3615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.498519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6fa1c926-16c0-4373-93fe-dedd98fd3615 None None] MFA Rules not processed for user `f49f128f82d3459b83ee0cdea7437a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:09.499732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6fa1c926-16c0-4373-93fe-dedd98fd3615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:09.577659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 941/1922] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:09.579824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558fda4-998d-4cb3-b155-b89017f64b83 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.580268 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558fda4-998d-4cb3-b155-b89017f64b83 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.580681 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558fda4-998d-4cb3-b155-b89017f64b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.598055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:09.604183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4558fda4-998d-4cb3-b155-b89017f64b83 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:09.605570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4558fda4-998d-4cb3-b155-b89017f64b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:09.614153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 942/1923] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:09.615518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30e3ee-2e07-4657-8260-a9dba6e65238 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.615800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30e3ee-2e07-4657-8260-a9dba6e65238 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.616069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30e3ee-2e07-4657-8260-a9dba6e65238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.623493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870e3777744b4c7f8e5e648946c75248'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.625765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870e3777744b4c7f8e5e648946c75248'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.631490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870e3777744b4c7f8e5e648946c75248'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.634562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4b30e3ee-2e07-4657-8260-a9dba6e65238 None None] MFA Rules not processed for user `c1b2fa1ad837485e8485417c986fcf0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:09.635756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4b30e3ee-2e07-4657-8260-a9dba6e65238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:09.690172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 943/1924] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:09.691358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19ab8e-fc05-4b4e-8bbf-dab1acb4488f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.691643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19ab8e-fc05-4b4e-8bbf-dab1acb4488f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.691915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19ab8e-fc05-4b4e-8bbf-dab1acb4488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.706559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870e3777744b4c7f8e5e648946c75248'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.708700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870e3777744b4c7f8e5e648946c75248'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:09.713930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5a19ab8e-fc05-4b4e-8bbf-dab1acb4488f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:09.715277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a19ab8e-fc05-4b4e-8bbf-dab1acb4488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:09.729280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 944/1925] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:09.730269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19ab8e-fc05-4b4e-8bbf-dab1acb4488f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:09.741272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a19ab8e-fc05-4b4e-8bbf-dab1acb4488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:09.741614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 982/1926] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:09 2022] DELETE /identity/v3/users/870e3777744b4c7f8e5e648946c75248 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:09.741614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:09.858021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19ab8e-fc05-4b4e-8bbf-dab1acb4488f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:09.868947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f777f9b-f6e6-435e-b8bf-5d2f72d4cb0a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:09.880902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257f09-8e23-43df-8037-b979e04d5edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:09.881556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257f09-8e23-43df-8037-b979e04d5edd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.881841 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257f09-8e23-43df-8037-b979e04d5edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.882145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1257f09-8e23-43df-8037-b979e04d5edd admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.886808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257f09-8e23-43df-8037-b979e04d5edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:09.886808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257f09-8e23-43df-8037-b979e04d5edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:09.888874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1257f09-8e23-43df-8037-b979e04d5edd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:09.910131 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 983/1927] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:09.913872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257f09-8e23-43df-8037-b979e04d5edd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:09.927207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1257f09-8e23-43df-8037-b979e04d5edd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:09.946983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462253-311f-45ba-a7c1-1e1ee468092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:09.947635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462253-311f-45ba-a7c1-1e1ee468092c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.947922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462253-311f-45ba-a7c1-1e1ee468092c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.948193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a462253-311f-45ba-a7c1-1e1ee468092c admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.948845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462253-311f-45ba-a7c1-1e1ee468092c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:09.955241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a462253-311f-45ba-a7c1-1e1ee468092c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:09.957753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e706252-510e-4ef7-8e8c-dbb8321f2475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:09.958421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e706252-510e-4ef7-8e8c-dbb8321f2475 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:09.958742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e706252-510e-4ef7-8e8c-dbb8321f2475 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:09.959039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e706252-510e-4ef7-8e8c-dbb8321f2475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:09.961097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8e706252-510e-4ef7-8e8c-dbb8321f2475 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:10.036507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e706252-510e-4ef7-8e8c-dbb8321f2475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.039184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e706252-510e-4ef7-8e8c-dbb8321f2475 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.058319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 945/1928] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:10.071852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 984/1929] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:09 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:10.078164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e706252-510e-4ef7-8e8c-dbb8321f2475 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.089953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e706252-510e-4ef7-8e8c-dbb8321f2475 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.172197 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a622b7-1df3-4c90-acc5-385dc34e27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.173341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a622b7-1df3-4c90-acc5-385dc34e27c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.173628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a622b7-1df3-4c90-acc5-385dc34e27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.173957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a622b7-1df3-4c90-acc5-385dc34e27c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.174643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a622b7-1df3-4c90-acc5-385dc34e27c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.176582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a622b7-1df3-4c90-acc5-385dc34e27c8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.229086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462253-311f-45ba-a7c1-1e1ee468092c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.230991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a462253-311f-45ba-a7c1-1e1ee468092c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:10.251356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a462253-311f-45ba-a7c1-1e1ee468092c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.256497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.257329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.257614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.257932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] PATH_INFO: `/v3/projects/574e494c09384d93bfe1729a946503e1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.259378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=574e494c09384d93bfe1729a946503e1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.261535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.296158 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 946/1930] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:10 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:10.300714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a622b7-1df3-4c90-acc5-385dc34e27c8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.311286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a622b7-1df3-4c90-acc5-385dc34e27c8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.316581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830823a9-7d95-4d0a-8754-55b2edf1e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.317214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830823a9-7d95-4d0a-8754-55b2edf1e5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.317494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830823a9-7d95-4d0a-8754-55b2edf1e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.317768 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830823a9-7d95-4d0a-8754-55b2edf1e5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.318447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830823a9-7d95-4d0a-8754-55b2edf1e5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.320047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830823a9-7d95-4d0a-8754-55b2edf1e5d1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.330941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 947/1931] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:10.335417 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830823a9-7d95-4d0a-8754-55b2edf1e5d1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.337059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:10.346963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830823a9-7d95-4d0a-8754-55b2edf1e5d1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.352777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a38b3-661d-4cfb-a431-0c9c2bb7f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.353455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a38b3-661d-4cfb-a431-0c9c2bb7f487 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.353802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a38b3-661d-4cfb-a431-0c9c2bb7f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.354187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a38b3-661d-4cfb-a431-0c9c2bb7f487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.354902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a38b3-661d-4cfb-a431-0c9c2bb7f487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.356574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a38b3-661d-4cfb-a431-0c9c2bb7f487 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.368172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 948/1932] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:10.372577 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a38b3-661d-4cfb-a431-0c9c2bb7f487 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.382947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a38b3-661d-4cfb-a431-0c9c2bb7f487 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.387715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21570f-2ea1-45f2-b819-0acd69471b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.388359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21570f-2ea1-45f2-b819-0acd69471b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.388645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21570f-2ea1-45f2-b819-0acd69471b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.389565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21570f-2ea1-45f2-b819-0acd69471b08 admin admin] PATH_INFO: `/v3/projects/979ccfd7ddee4929bef2b79d3d7eea83/users/62f9e98f9c9d4c40a163794119f66ee6/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.404277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21570f-2ea1-45f2-b819-0acd69471b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979ccfd7ddee4929bef2b79d3d7eea83, user_id=62f9e98f9c9d4c40a163794119f66ee6, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.407041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21570f-2ea1-45f2-b819-0acd69471b08 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.484450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 949/1933] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:10 2022] PUT /identity/v3/projects/979ccfd7ddee4929bef2b79d3d7eea83/users/62f9e98f9c9d4c40a163794119f66ee6/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:10.487354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574e494c09384d93bfe1729a946503e1', 'request_id': 'req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:10.494611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574e494c09384d93bfe1729a946503e1', 'request_id': 'req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:10.495848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c3ca5-7df2-4738-9504-a9743ab2a2e1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.496151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c3ca5-7df2-4738-9504-a9743ab2a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.496428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c3ca5-7df2-4738-9504-a9743ab2a2e1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.501086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 950/1934] 10.222.0.33 () {54 vars in 912 bytes} [Tue Oct 4 09:02:10 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:02:10.501086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3dfd-4f9d-4a5c-add8-20008436507e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.501086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3dfd-4f9d-4a5c-add8-20008436507e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.501086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3dfd-4f9d-4a5c-add8-20008436507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.527571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b2eb3dfd-4f9d-4a5c-add8-20008436507e None None] MFA Rules not processed for user `62f9e98f9c9d4c40a163794119f66ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:10.528863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b2eb3dfd-4f9d-4a5c-add8-20008436507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:10.548735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:10.549469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574e494c09384d93bfe1729a946503e1', 'request_id': 'req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:10.561048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] The token cache is being invalidate because project 574e494c09384d93bfe1729a946503e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:10.561336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:10.561971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ddf7e31-f8f6-4df3-bc7c-3579b53e79ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:10.563541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 985/1935] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:10 2022] DELETE /identity/v3/projects/574e494c09384d93bfe1729a946503e1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:10.569103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707dec6-359a-41c8-9371-d12dc4e3970f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.569389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707dec6-359a-41c8-9371-d12dc4e3970f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.569887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707dec6-359a-41c8-9371-d12dc4e3970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.588888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9707dec6-359a-41c8-9371-d12dc4e3970f None None] MFA Rules not processed for user `e0b66989d4df4398ad723f587cbc24bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:10.590003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9707dec6-359a-41c8-9371-d12dc4e3970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:10.596287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 951/1936] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:10.597567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fce2b3-70a5-4aa3-92e1-ce74557aef77 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.597855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fce2b3-70a5-4aa3-92e1-ce74557aef77 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.598160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fce2b3-70a5-4aa3-92e1-ce74557aef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.620964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-25fce2b3-70a5-4aa3-92e1-ce74557aef77 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:10.622336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-25fce2b3-70a5-4aa3-92e1-ce74557aef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:10.645853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 986/1937] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:10.646653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707dec6-359a-41c8-9371-d12dc4e3970f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.648194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9707dec6-359a-41c8-9371-d12dc4e3970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:10.687319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 952/1938] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:10.688210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fce2b3-70a5-4aa3-92e1-ce74557aef77 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.689492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-25fce2b3-70a5-4aa3-92e1-ce74557aef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:10.700987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fce2b3-70a5-4aa3-92e1-ce74557aef77 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.704748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6b5cd-10ba-4c81-aad5-729613957542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.705471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6b5cd-10ba-4c81-aad5-729613957542 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.705885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6b5cd-10ba-4c81-aad5-729613957542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.706186 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6b5cd-10ba-4c81-aad5-729613957542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.713147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6b5cd-10ba-4c81-aad5-729613957542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.714619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6b5cd-10ba-4c81-aad5-729613957542 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.720057 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707dec6-359a-41c8-9371-d12dc4e3970f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.722843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 953/1939] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:10.723968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db705f-62e2-4bcc-8471-5ea44a7e5fcf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.724255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db705f-62e2-4bcc-8471-5ea44a7e5fcf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.724532 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db705f-62e2-4bcc-8471-5ea44a7e5fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.726939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69010c-9bdf-4fa4-8fa5-4dcc115887eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.727559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69010c-9bdf-4fa4-8fa5-4dcc115887eb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.727844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69010c-9bdf-4fa4-8fa5-4dcc115887eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.728119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69010c-9bdf-4fa4-8fa5-4dcc115887eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.728859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69010c-9bdf-4fa4-8fa5-4dcc115887eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.730953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69010c-9bdf-4fa4-8fa5-4dcc115887eb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.761302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-53db705f-62e2-4bcc-8471-5ea44a7e5fcf None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:10.762565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-53db705f-62e2-4bcc-8471-5ea44a7e5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:10.770975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 954/1940] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:10.775757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db705f-62e2-4bcc-8471-5ea44a7e5fcf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.785980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db705f-62e2-4bcc-8471-5ea44a7e5fcf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.791704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67896-0fa7-4588-8eb8-6d4d8a73c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.792308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67896-0fa7-4588-8eb8-6d4d8a73c574 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.792588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67896-0fa7-4588-8eb8-6d4d8a73c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.792861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67896-0fa7-4588-8eb8-6d4d8a73c574 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.793491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c67896-0fa7-4588-8eb8-6d4d8a73c574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:10.802131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c67896-0fa7-4588-8eb8-6d4d8a73c574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.802131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c67896-0fa7-4588-8eb8-6d4d8a73c574 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.809501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 955/1941] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 09:02:10.814357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67896-0fa7-4588-8eb8-6d4d8a73c574 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.823858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 987/1942] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:10 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:10.826899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67896-0fa7-4588-8eb8-6d4d8a73c574 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.827909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69010c-9bdf-4fa4-8fa5-4dcc115887eb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:10.916830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59304-734c-464a-9310-c27b3cbdffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.917462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59304-734c-464a-9310-c27b3cbdffbc admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.917745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59304-734c-464a-9310-c27b3cbdffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.918020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a59304-734c-464a-9310-c27b3cbdffbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.922291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a59304-734c-464a-9310-c27b3cbdffbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.924478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a59304-734c-464a-9310-c27b3cbdffbc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:10.968199 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69010c-9bdf-4fa4-8fa5-4dcc115887eb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:10.974999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c82593-eec2-4626-aff5-ca5b02185e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:10.980255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c82593-eec2-4626-aff5-ca5b02185e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:10.980255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c82593-eec2-4626-aff5-ca5b02185e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:10.980255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c82593-eec2-4626-aff5-ca5b02185e66 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:10.980255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c82593-eec2-4626-aff5-ca5b02185e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:10.980255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c82593-eec2-4626-aff5-ca5b02185e66 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.143874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 956/1943] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:10 2022] POST /identity/v3/projects => generated 407 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:11.145321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 988/1944] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:10 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:11.148755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59304-734c-464a-9310-c27b3cbdffbc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.154004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c82593-eec2-4626-aff5-ca5b02185e66 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.169206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c82593-eec2-4626-aff5-ca5b02185e66 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.211594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a59304-734c-464a-9310-c27b3cbdffbc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.216298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9a7db-ec99-4ce3-99b9-90ca19abbfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.216909 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9a7db-ec99-4ce3-99b9-90ca19abbfaf admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.217189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9a7db-ec99-4ce3-99b9-90ca19abbfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.217459 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9a7db-ec99-4ce3-99b9-90ca19abbfaf admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.218113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9a7db-ec99-4ce3-99b9-90ca19abbfaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.220919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9a7db-ec99-4ce3-99b9-90ca19abbfaf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.247178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccc301-f1cd-4583-94a5-5f1c8672727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.248086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccc301-f1cd-4583-94a5-5f1c8672727d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.248590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccc301-f1cd-4583-94a5-5f1c8672727d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.249073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccc301-f1cd-4583-94a5-5f1c8672727d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.250112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccc301-f1cd-4583-94a5-5f1c8672727d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.252543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccc301-f1cd-4583-94a5-5f1c8672727d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.264915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 989/1945] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:11.270493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccc301-f1cd-4583-94a5-5f1c8672727d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.287780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccc301-f1cd-4583-94a5-5f1c8672727d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.293785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6316bd3-4f01-4aaa-a411-100cf70fef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.294418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6316bd3-4f01-4aaa-a411-100cf70fef92 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.294702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6316bd3-4f01-4aaa-a411-100cf70fef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.294972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6316bd3-4f01-4aaa-a411-100cf70fef92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.298784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6316bd3-4f01-4aaa-a411-100cf70fef92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.298784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6316bd3-4f01-4aaa-a411-100cf70fef92 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.314426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 990/1946] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:11.318665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6316bd3-4f01-4aaa-a411-100cf70fef92 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.319698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:11.331230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6316bd3-4f01-4aaa-a411-100cf70fef92 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.336390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bbff5-0ab3-4486-b11b-128e315359a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.337213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bbff5-0ab3-4486-b11b-128e315359a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.337499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bbff5-0ab3-4486-b11b-128e315359a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.337776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bbff5-0ab3-4486-b11b-128e315359a0 admin admin] PATH_INFO: `/v3/projects/3cdd99861d2947e1a569fe620e4c13ad/users/cf41e7cfc67645dd99c1d8fb1299fd32/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.359827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bbff5-0ab3-4486-b11b-128e315359a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdd99861d2947e1a569fe620e4c13ad, user_id=cf41e7cfc67645dd99c1d8fb1299fd32, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.363274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bbff5-0ab3-4486-b11b-128e315359a0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.382621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 957/1947] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:11 2022] POST /identity/v3/users => generated 304 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:11.384418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9a7db-ec99-4ce3-99b9-90ca19abbfaf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.419980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9a7db-ec99-4ce3-99b9-90ca19abbfaf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.434129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 991/1948] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:11 2022] PUT /identity/v3/projects/3cdd99861d2947e1a569fe620e4c13ad/users/cf41e7cfc67645dd99c1d8fb1299fd32/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:11.448321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c132ba-e538-4290-be89-7722c9dceeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.448321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c132ba-e538-4290-be89-7722c9dceeef admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.448321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c132ba-e538-4290-be89-7722c9dceeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.448321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c132ba-e538-4290-be89-7722c9dceeef admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.448959 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa5708-bbf5-4249-8488-244cac9d1e88 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.448959 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa5708-bbf5-4249-8488-244cac9d1e88 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.448959 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa5708-bbf5-4249-8488-244cac9d1e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.449218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c132ba-e538-4290-be89-7722c9dceeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.451827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c132ba-e538-4290-be89-7722c9dceeef admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.501514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 958/1949] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:11.502540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c132ba-e538-4290-be89-7722c9dceeef admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.509205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7eaa5708-bbf5-4249-8488-244cac9d1e88 None None] MFA Rules not processed for user `cf41e7cfc67645dd99c1d8fb1299fd32`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:11.510470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7eaa5708-bbf5-4249-8488-244cac9d1e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:11.520126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c132ba-e538-4290-be89-7722c9dceeef admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.605960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ee6e9-3d43-4d68-92b6-b03edd597295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.606771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee6e9-3d43-4d68-92b6-b03edd597295 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.606954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee6e9-3d43-4d68-92b6-b03edd597295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.607299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee6e9-3d43-4d68-92b6-b03edd597295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.607979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ee6e9-3d43-4d68-92b6-b03edd597295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.609606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ee6e9-3d43-4d68-92b6-b03edd597295 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.612912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 992/1950] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:11.617400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa5708-bbf5-4249-8488-244cac9d1e88 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.624726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 959/1951] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:11.629781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ee6e9-3d43-4d68-92b6-b03edd597295 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.630303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa5708-bbf5-4249-8488-244cac9d1e88 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.636215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895dd2f-0117-4d8c-ad0d-452e01a079fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.636924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895dd2f-0117-4d8c-ad0d-452e01a079fd admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.637405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895dd2f-0117-4d8c-ad0d-452e01a079fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.637555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895dd2f-0117-4d8c-ad0d-452e01a079fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.638522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895dd2f-0117-4d8c-ad0d-452e01a079fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.640555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895dd2f-0117-4d8c-ad0d-452e01a079fd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.643458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ee6e9-3d43-4d68-92b6-b03edd597295 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.656936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610e32e-3502-4feb-b65b-ea400c80a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.657776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e32e-3502-4feb-b65b-ea400c80a4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.658060 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e32e-3502-4feb-b65b-ea400c80a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.658451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e32e-3502-4feb-b65b-ea400c80a4cd admin admin] PATH_INFO: `/v3/projects/83698261a7584eaf9c1385e9c011c4a8/users/bbd72c52364e462c818abb8ce067ece8/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.674842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610e32e-3502-4feb-b65b-ea400c80a4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83698261a7584eaf9c1385e9c011c4a8, user_id=bbd72c52364e462c818abb8ce067ece8, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.677582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610e32e-3502-4feb-b65b-ea400c80a4cd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.767575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 993/1952] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:11 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:11.770290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895dd2f-0117-4d8c-ad0d-452e01a079fd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.792843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 960/1953] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:11 2022] PUT /identity/v3/projects/83698261a7584eaf9c1385e9c011c4a8/users/bbd72c52364e462c818abb8ce067ece8/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:11.808437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e9d84-f0a8-416d-bfea-079d1a50e02e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.808794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e9d84-f0a8-416d-bfea-079d1a50e02e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.809075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e9d84-f0a8-416d-bfea-079d1a50e02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.836346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895dd2f-0117-4d8c-ad0d-452e01a079fd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.837380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b75e9d84-f0a8-416d-bfea-079d1a50e02e None None] MFA Rules not processed for user `bbd72c52364e462c818abb8ce067ece8`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:11.838642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b75e9d84-f0a8-416d-bfea-079d1a50e02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:11.892969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682dec1-c79f-450d-857e-a39820d3bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.893669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682dec1-c79f-450d-857e-a39820d3bfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.894208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682dec1-c79f-450d-857e-a39820d3bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.894573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682dec1-c79f-450d-857e-a39820d3bfa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.895217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682dec1-c79f-450d-857e-a39820d3bfa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.897260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682dec1-c79f-450d-857e-a39820d3bfa6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.905937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 961/1954] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:11 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:11.910947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e9d84-f0a8-416d-bfea-079d1a50e02e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:11.921156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e9d84-f0a8-416d-bfea-079d1a50e02e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:11.926356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b15c-c1e5-4d67-a5a6-a29d575eb7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:11.929540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b15c-c1e5-4d67-a5a6-a29d575eb7ac admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:11.929540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b15c-c1e5-4d67-a5a6-a29d575eb7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:11.929540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b15c-c1e5-4d67-a5a6-a29d575eb7ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:11.929540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b15c-c1e5-4d67-a5a6-a29d575eb7ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:11.930372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b15c-c1e5-4d67-a5a6-a29d575eb7ac admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:11.990858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 994/1955] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:11 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:11.992023 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682dec1-c79f-450d-857e-a39820d3bfa6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.003422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682dec1-c79f-450d-857e-a39820d3bfa6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.005827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 962/1956] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:11 2022] POST /identity/v3/projects => generated 409 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:12.009854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b15c-c1e5-4d67-a5a6-a29d575eb7ac admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.012617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61ebe1-a06d-439c-82cc-4d86d5c298f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.012890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61ebe1-a06d-439c-82cc-4d86d5c298f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.013173 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61ebe1-a06d-439c-82cc-4d86d5c298f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.013448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61ebe1-a06d-439c-82cc-4d86d5c298f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.014200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61ebe1-a06d-439c-82cc-4d86d5c298f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.022004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61ebe1-a06d-439c-82cc-4d86d5c298f8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.033286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 995/1957] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:12.041408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61ebe1-a06d-439c-82cc-4d86d5c298f8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.051877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:12.055506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61ebe1-a06d-439c-82cc-4d86d5c298f8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.076818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b15c-c1e5-4d67-a5a6-a29d575eb7ac admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.081732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c056234-4e08-4dbe-b89f-39ee9c9c9c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.082619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c056234-4e08-4dbe-b89f-39ee9c9c9c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.082746 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c056234-4e08-4dbe-b89f-39ee9c9c9c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.082956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c056234-4e08-4dbe-b89f-39ee9c9c9c9a admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.083780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c056234-4e08-4dbe-b89f-39ee9c9c9c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.085720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c056234-4e08-4dbe-b89f-39ee9c9c9c9a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.115896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915d3d7-7108-4430-af90-17d42f1ba5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.116562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915d3d7-7108-4430-af90-17d42f1ba5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.116916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915d3d7-7108-4430-af90-17d42f1ba5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.117200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915d3d7-7108-4430-af90-17d42f1ba5b9 admin admin] PATH_INFO: `/v3/projects/6a75c61d9d3547dba9948944ba6b5bda/users/c5f816bb835f4c528aa95b2163812d14/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.130944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915d3d7-7108-4430-af90-17d42f1ba5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a75c61d9d3547dba9948944ba6b5bda, user_id=c5f816bb835f4c528aa95b2163812d14, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.133604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915d3d7-7108-4430-af90-17d42f1ba5b9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.176594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 963/1958] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:12 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:12.180485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c056234-4e08-4dbe-b89f-39ee9c9c9c9a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.190259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c056234-4e08-4dbe-b89f-39ee9c9c9c9a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.194845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d7048-f40b-4338-a287-22bac3c41a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.195429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d7048-f40b-4338-a287-22bac3c41a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.195710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d7048-f40b-4338-a287-22bac3c41a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.195983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d7048-f40b-4338-a287-22bac3c41a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.196845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d7048-f40b-4338-a287-22bac3c41a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.198333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d7048-f40b-4338-a287-22bac3c41a7f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.205420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 996/1959] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:12 2022] PUT /identity/v3/projects/6a75c61d9d3547dba9948944ba6b5bda/users/c5f816bb835f4c528aa95b2163812d14/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:12.209664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 964/1960] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:12.209887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915d3d7-7108-4430-af90-17d42f1ba5b9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.213521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d7048-f40b-4338-a287-22bac3c41a7f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.223753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d7048-f40b-4338-a287-22bac3c41a7f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.274777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915d3d7-7108-4430-af90-17d42f1ba5b9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.279290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd14bc-2791-460a-a378-7bd02a934eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.279453 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8db4-1d0e-4d97-a55d-a3b82375d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.279926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8db4-1d0e-4d97-a55d-a3b82375d786 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.280055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd14bc-2791-460a-a378-7bd02a934eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.280215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8db4-1d0e-4d97-a55d-a3b82375d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.280320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd14bc-2791-460a-a378-7bd02a934eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.280514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8db4-1d0e-4d97-a55d-a3b82375d786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.280608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd14bc-2791-460a-a378-7bd02a934eb2 admin admin] PATH_INFO: `/v3/projects/acbcb12b790b478bbf9e56fdc1f2275f/users/162f64ad04634c788b29439b96667fa4/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.281129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac8db4-1d0e-4d97-a55d-a3b82375d786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.283300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac8db4-1d0e-4d97-a55d-a3b82375d786 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.295875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 997/1961] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:12.298300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8db4-1d0e-4d97-a55d-a3b82375d786 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.299428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd14bc-2791-460a-a378-7bd02a934eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbcb12b790b478bbf9e56fdc1f2275f, user_id=162f64ad04634c788b29439b96667fa4, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.302239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd14bc-2791-460a-a378-7bd02a934eb2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.308413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8db4-1d0e-4d97-a55d-a3b82375d786 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.313452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955869b-1ee1-4a6e-bdd8-777feda31384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.314164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955869b-1ee1-4a6e-bdd8-777feda31384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.314452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955869b-1ee1-4a6e-bdd8-777feda31384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.318846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955869b-1ee1-4a6e-bdd8-777feda31384 admin admin] PATH_INFO: `/v3/projects/6a75c61d9d3547dba9948944ba6b5bda/users/c5f816bb835f4c528aa95b2163812d14/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.318846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955869b-1ee1-4a6e-bdd8-777feda31384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a75c61d9d3547dba9948944ba6b5bda, user_id=c5f816bb835f4c528aa95b2163812d14, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.319870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955869b-1ee1-4a6e-bdd8-777feda31384 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.330412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 998/1962] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:12 2022] PUT /identity/v3/projects/6a75c61d9d3547dba9948944ba6b5bda/users/c5f816bb835f4c528aa95b2163812d14/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:12.341565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa328046-499a-4510-8be7-1deb1abed938 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.343235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa328046-499a-4510-8be7-1deb1abed938 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.343235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa328046-499a-4510-8be7-1deb1abed938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.372112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fa328046-499a-4510-8be7-1deb1abed938 None None] MFA Rules not processed for user `c5f816bb835f4c528aa95b2163812d14`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:12.373479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa328046-499a-4510-8be7-1deb1abed938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:12.410612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:12.420827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 965/1963] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:12 2022] PUT /identity/v3/projects/acbcb12b790b478bbf9e56fdc1f2275f/users/162f64ad04634c788b29439b96667fa4/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:12.422124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd14bc-2791-460a-a378-7bd02a934eb2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.461272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 999/1964] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:12.473572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa328046-499a-4510-8be7-1deb1abed938 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.474995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa328046-499a-4510-8be7-1deb1abed938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:12.487462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd14bc-2791-460a-a378-7bd02a934eb2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.492388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f40fb3-5d65-4f8e-8b4a-aeec75f1c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.493010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f40fb3-5d65-4f8e-8b4a-aeec75f1c135 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.493294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f40fb3-5d65-4f8e-8b4a-aeec75f1c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.493575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f40fb3-5d65-4f8e-8b4a-aeec75f1c135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.494266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f40fb3-5d65-4f8e-8b4a-aeec75f1c135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.495972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f40fb3-5d65-4f8e-8b4a-aeec75f1c135 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.506856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 966/1965] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:12.510669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f40fb3-5d65-4f8e-8b4a-aeec75f1c135 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.521005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f40fb3-5d65-4f8e-8b4a-aeec75f1c135 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.525976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877760c-6a92-4440-83bc-3b83f74fda5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.526554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877760c-6a92-4440-83bc-3b83f74fda5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.526849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877760c-6a92-4440-83bc-3b83f74fda5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.527235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877760c-6a92-4440-83bc-3b83f74fda5f admin admin] PATH_INFO: `/v3/projects/acbcb12b790b478bbf9e56fdc1f2275f/users/162f64ad04634c788b29439b96667fa4/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.529646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877760c-6a92-4440-83bc-3b83f74fda5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbcb12b790b478bbf9e56fdc1f2275f, user_id=162f64ad04634c788b29439b96667fa4, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.533150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877760c-6a92-4440-83bc-3b83f74fda5f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.543811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 967/1966] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:12 2022] PUT /identity/v3/projects/acbcb12b790b478bbf9e56fdc1f2275f/users/162f64ad04634c788b29439b96667fa4/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:12.552489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa328046-499a-4510-8be7-1deb1abed938 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.553812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69509-dc2b-4174-8334-eddfc19ecc72 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.554128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69509-dc2b-4174-8334-eddfc19ecc72 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.554444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69509-dc2b-4174-8334-eddfc19ecc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.586491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-add69509-dc2b-4174-8334-eddfc19ecc72 None None] MFA Rules not processed for user `162f64ad04634c788b29439b96667fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:12.587818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-add69509-dc2b-4174-8334-eddfc19ecc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:12.605267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b40abb-7e13-4f6d-bbcc-65e5d7f2e1f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.605946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b40abb-7e13-4f6d-bbcc-65e5d7f2e1f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.606248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b40abb-7e13-4f6d-bbcc-65e5d7f2e1f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.606525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b40abb-7e13-4f6d-bbcc-65e5d7f2e1f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.657328 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:12.661551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 968/1967] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:12 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:12.679048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b40abb-7e13-4f6d-bbcc-65e5d7f2e1f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.681888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b40abb-7e13-4f6d-bbcc-65e5d7f2e1f2 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.692474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1000/1968] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:12.834308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69509-dc2b-4174-8334-eddfc19ecc72 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.844321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69509-dc2b-4174-8334-eddfc19ecc72 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:12.848243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13469b58-5541-4dfc-b162-64dd87897491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:12.848831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13469b58-5541-4dfc-b162-64dd87897491 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:12.856626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13469b58-5541-4dfc-b162-64dd87897491 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:12.856626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13469b58-5541-4dfc-b162-64dd87897491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:12.859636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13469b58-5541-4dfc-b162-64dd87897491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:12.861140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13469b58-5541-4dfc-b162-64dd87897491 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:12.872299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 969/1969] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:12 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:12.976163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:12.985459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b40abb-7e13-4f6d-bbcc-65e5d7f2e1f2 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:12.995316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b40abb-7e13-4f6d-bbcc-65e5d7f2e1f2 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:13.000270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08757706-090f-4e29-b9b2-a0bd39fac9a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:13.001572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08757706-090f-4e29-b9b2-a0bd39fac9a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:13.001930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08757706-090f-4e29-b9b2-a0bd39fac9a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:13.002329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08757706-090f-4e29-b9b2-a0bd39fac9a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:13.059766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08757706-090f-4e29-b9b2-a0bd39fac9a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:13.061265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08757706-090f-4e29-b9b2-a0bd39fac9a2 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:13.071032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1001/1970] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:13.216544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:13.504766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13469b58-5541-4dfc-b162-64dd87897491 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:13.506569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-13469b58-5541-4dfc-b162-64dd87897491 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:13.520910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13469b58-5541-4dfc-b162-64dd87897491 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:13.527183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57457aa0-5542-4d29-8c88-cc105b825eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:13.527980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57457aa0-5542-4d29-8c88-cc105b825eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:13.528669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57457aa0-5542-4d29-8c88-cc105b825eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:13.529276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57457aa0-5542-4d29-8c88-cc105b825eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:13.559008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:13.617022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57457aa0-5542-4d29-8c88-cc105b825eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:13.618635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57457aa0-5542-4d29-8c88-cc105b825eb4 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:13.629629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 970/1971] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:13 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:14.251340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:14.382300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:14.433579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:15.514597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:15.776578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:16.662194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:17.216288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:18.130130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:18.132783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08757706-090f-4e29-b9b2-a0bd39fac9a2 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:18.134390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-08757706-090f-4e29-b9b2-a0bd39fac9a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:18.227982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08757706-090f-4e29-b9b2-a0bd39fac9a2 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:18.233157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:18.233800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:18.234104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:18.234421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] PATH_INFO: `/v3/users/5fbe1351b8824501aa268e317ca6b8e3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:18.236306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbe1351b8824501aa268e317ca6b8e3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:18.238265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:18.296350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:18.351342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57457aa0-5542-4d29-8c88-cc105b825eb4 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:18.362735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57457aa0-5542-4d29-8c88-cc105b825eb4 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:18.367416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:18.368167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:18.368541 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:18.368907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] PATH_INFO: `/v3/users/62f9e98f9c9d4c40a163794119f66ee6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:18.370145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f9e98f9c9d4c40a163794119f66ee6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:18.372167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:18.471482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbe1351b8824501aa268e317ca6b8e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.472113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbe1351b8824501aa268e317ca6b8e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.482132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbe1351b8824501aa268e317ca6b8e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.529325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbe1351b8824501aa268e317ca6b8e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.529972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06568cac-1425-4364-bdb9-1ca36fe09ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbe1351b8824501aa268e317ca6b8e3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.551711 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f9e98f9c9d4c40a163794119f66ee6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.552770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f9e98f9c9d4c40a163794119f66ee6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.560175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1002/1972] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:18 2022] DELETE /identity/v3/users/5fbe1351b8824501aa268e317ca6b8e3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:18.560971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f9e98f9c9d4c40a163794119f66ee6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.561778 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f9e98f9c9d4c40a163794119f66ee6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.564815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938096ef-2bf3-4428-a627-67d5e9ab6c9e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:18.565112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938096ef-2bf3-4428-a627-67d5e9ab6c9e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:18.565391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938096ef-2bf3-4428-a627-67d5e9ab6c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:18.576247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d594ffc3-a22e-4af2-95b2-bfc61162aaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f9e98f9c9d4c40a163794119f66ee6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:18.586578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-938096ef-2bf3-4428-a627-67d5e9ab6c9e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:18.587807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-938096ef-2bf3-4428-a627-67d5e9ab6c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:18.644725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 971/1973] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:18 2022] DELETE /identity/v3/users/62f9e98f9c9d4c40a163794119f66ee6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:18.656038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb78bc-4a35-4ae0-8028-77b1cb5da401 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:18.656038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb78bc-4a35-4ae0-8028-77b1cb5da401 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:18.656038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb78bc-4a35-4ae0-8028-77b1cb5da401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:18.657245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1003/1974] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:18.665871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938096ef-2bf3-4428-a627-67d5e9ab6c9e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:18.667409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-938096ef-2bf3-4428-a627-67d5e9ab6c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:18.678697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d9fb78bc-4a35-4ae0-8028-77b1cb5da401 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:18.680203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d9fb78bc-4a35-4ae0-8028-77b1cb5da401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:18.757707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938096ef-2bf3-4428-a627-67d5e9ab6c9e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:18.794536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 972/1975] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:18.804257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb78bc-4a35-4ae0-8028-77b1cb5da401 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:18.817991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=1,keystone:SELECT=92,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:18.824455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15e01c-8c65-4673-b68b-a6e0df90161f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:18.825259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15e01c-8c65-4673-b68b-a6e0df90161f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:18.825558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15e01c-8c65-4673-b68b-a6e0df90161f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:18.826194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15e01c-8c65-4673-b68b-a6e0df90161f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:18.836972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15e01c-8c65-4673-b68b-a6e0df90161f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:18.838640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15e01c-8c65-4673-b68b-a6e0df90161f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:18.849324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1004/1976] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:18.868097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb78bc-4a35-4ae0-8028-77b1cb5da401 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:18.872019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4aef8-c505-41b3-a44c-a27f6d2a3276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:18.873103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4aef8-c505-41b3-a44c-a27f6d2a3276 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:18.873103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4aef8-c505-41b3-a44c-a27f6d2a3276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:18.873313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4aef8-c505-41b3-a44c-a27f6d2a3276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:18.884786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4aef8-c505-41b3-a44c-a27f6d2a3276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:18.887687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4aef8-c505-41b3-a44c-a27f6d2a3276 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:18.898488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 973/1977] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:18.993331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:19.479071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:19.490253 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15e01c-8c65-4673-b68b-a6e0df90161f service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:19.491630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ee15e01c-8c65-4673-b68b-a6e0df90161f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:19.505769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15e01c-8c65-4673-b68b-a6e0df90161f service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:19.511719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:19.512643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:19.513038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:19.513418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] PATH_INFO: `/v3/projects/c20317a162ef4dfb9874d600794158f8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:19.514732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20317a162ef4dfb9874d600794158f8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:19.516986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:19.536293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4aef8-c505-41b3-a44c-a27f6d2a3276 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:19.538328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6cf4aef8-c505-41b3-a44c-a27f6d2a3276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:19.587219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4aef8-c505-41b3-a44c-a27f6d2a3276 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:19.598163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:19.598829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:19.599117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:19.599388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] PATH_INFO: `/v3/projects/979ccfd7ddee4929bef2b79d3d7eea83` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:19.600545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=979ccfd7ddee4929bef2b79d3d7eea83)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:19.602597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:19.654418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20317a162ef4dfb9874d600794158f8', 'request_id': 'req-c337f8be-65cc-4169-a95d-4746a2eac17e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.673988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20317a162ef4dfb9874d600794158f8', 'request_id': 'req-c337f8be-65cc-4169-a95d-4746a2eac17e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.710485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979ccfd7ddee4929bef2b79d3d7eea83', 'request_id': 'req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.720084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979ccfd7ddee4929bef2b79d3d7eea83', 'request_id': 'req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.727541 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979ccfd7ddee4929bef2b79d3d7eea83', 'request_id': 'req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.747175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20317a162ef4dfb9874d600794158f8', 'request_id': 'req-c337f8be-65cc-4169-a95d-4746a2eac17e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.759923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] The token cache is being invalidate because project c20317a162ef4dfb9874d600794158f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:19.760218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.760884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.762505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1005/1978] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:19 2022] DELETE /identity/v3/projects/c20317a162ef4dfb9874d600794158f8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:19.766398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:19.767965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:19.829119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] The token cache is being invalidate because project 979ccfd7ddee4929bef2b79d3d7eea83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:19.829402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.831762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:19.834041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 974/1979] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:19 2022] DELETE /identity/v3/projects/979ccfd7ddee4929bef2b79d3d7eea83 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:19.838244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:19.839651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:19.874039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f8be-65cc-4169-a95d-4746a2eac17e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:19.986991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:19.987720 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:19.988005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:19.988331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] PATH_INFO: `/v3/users/0b8b0b79ba1c4225af64468f49c6172c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:19.989504 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8b0b79ba1c4225af64468f49c6172c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:19.992376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:20.016602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:20.022645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c9a4d-dcb5-47e4-97a7-3fe268be1a9a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:20.033893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:20.034723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:20.035036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:20.035308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] PATH_INFO: `/v3/users/cf41e7cfc67645dd99c1d8fb1299fd32` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:20.038948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf41e7cfc67645dd99c1d8fb1299fd32)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:20.043034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:20.216650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8b0b79ba1c4225af64468f49c6172c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.218493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf41e7cfc67645dd99c1d8fb1299fd32'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.219993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf41e7cfc67645dd99c1d8fb1299fd32'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.220541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8b0b79ba1c4225af64468f49c6172c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.235617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8b0b79ba1c4225af64468f49c6172c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.241296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf41e7cfc67645dd99c1d8fb1299fd32'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.244035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf41e7cfc67645dd99c1d8fb1299fd32'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.266894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf41e7cfc67645dd99c1d8fb1299fd32'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.329615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8b0b79ba1c4225af64468f49c6172c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.330280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8b0b79ba1c4225af64468f49c6172c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.366769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1006/1980] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:19 2022] DELETE /identity/v3/users/0b8b0b79ba1c4225af64468f49c6172c => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:20.444651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 975/1981] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:19 2022] DELETE /identity/v3/users/cf41e7cfc67645dd99c1d8fb1299fd32 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:20.760607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:20.768062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:20.862845 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0860fc-d9c1-419f-a696-77b53eee3f0d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:20.904416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:20.987562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:20.988262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:20.988549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:20.988842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] PATH_INFO: `/v3/users/a1cd38a2728d427e8af5c2622949c5a0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:20.990150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1cd38a2728d427e8af5c2622949c5a0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:20.992163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.149295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.150807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.164348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302782-f372-42bc-8385-49408f0aaaa2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.169472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.170565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.174931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.174931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] PATH_INFO: `/v3/projects/2c44f9984bad48adadb053f660cf6e4b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.174931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c44f9984bad48adadb053f660cf6e4b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.174931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.216239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1cd38a2728d427e8af5c2622949c5a0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.217567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1cd38a2728d427e8af5c2622949c5a0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.226246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1cd38a2728d427e8af5c2622949c5a0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.289286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1cd38a2728d427e8af5c2622949c5a0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.289919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1cd38a2728d427e8af5c2622949c5a0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.311885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c44f9984bad48adadb053f660cf6e4b', 'request_id': 'req-b493fb82-720c-48db-8a35-d42318223227'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.318073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1007/1982] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:20 2022] DELETE /identity/v3/users/a1cd38a2728d427e8af5c2622949c5a0 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:21.319256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.320962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c44f9984bad48adadb053f660cf6e4b', 'request_id': 'req-b493fb82-720c-48db-8a35-d42318223227'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.322903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.329427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c44f9984bad48adadb053f660cf6e4b', 'request_id': 'req-b493fb82-720c-48db-8a35-d42318223227'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.389338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] The token cache is being invalidate because project 2c44f9984bad48adadb053f660cf6e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:21.394830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.394830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.395185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66654c8a-51b3-4cb9-be17-323a60c31277 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.398738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 976/1983] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:21 2022] DELETE /identity/v3/projects/2c44f9984bad48adadb053f660cf6e4b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:21.398738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.398738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.401950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.402823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.403416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.403953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] PATH_INFO: `/v3/projects/3cdd99861d2947e1a569fe620e4c13ad` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.406027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cdd99861d2947e1a569fe620e4c13ad)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.408566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.465351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:21.492537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fb82-720c-48db-8a35-d42318223227 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.497407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.498076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.498381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.498651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] PATH_INFO: `/v3/users/bbd72c52364e462c818abb8ce067ece8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.499786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd72c52364e462c818abb8ce067ece8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.502343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.523764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cdd99861d2947e1a569fe620e4c13ad', 'request_id': 'req-7b5bc684-14d6-416f-817e-1b5239b37e87'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.530280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cdd99861d2947e1a569fe620e4c13ad', 'request_id': 'req-7b5bc684-14d6-416f-817e-1b5239b37e87'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.591993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cdd99861d2947e1a569fe620e4c13ad', 'request_id': 'req-7b5bc684-14d6-416f-817e-1b5239b37e87'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.602956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] The token cache is being invalidate because project 3cdd99861d2947e1a569fe620e4c13ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:21.603252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.603963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7b5bc684-14d6-416f-817e-1b5239b37e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.605491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1008/1984] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:21 2022] DELETE /identity/v3/projects/3cdd99861d2947e1a569fe620e4c13ad => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:21.608476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadafcb6-7148-4f6c-b708-b6a68933809c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.608476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadafcb6-7148-4f6c-b708-b6a68933809c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.608476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadafcb6-7148-4f6c-b708-b6a68933809c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.628182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-aadafcb6-7148-4f6c-b708-b6a68933809c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:21.629407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aadafcb6-7148-4f6c-b708-b6a68933809c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.704559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd72c52364e462c818abb8ce067ece8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.706434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd72c52364e462c818abb8ce067ece8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.724654 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd72c52364e462c818abb8ce067ece8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.724654 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd72c52364e462c818abb8ce067ece8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.725721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1009/1985] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:21.727007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280757-6a2a-46dd-97d5-f11f74c5edee None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.727306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280757-6a2a-46dd-97d5-f11f74c5edee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.727589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d280757-6a2a-46dd-97d5-f11f74c5edee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.737014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd72c52364e462c818abb8ce067ece8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.750684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6d280757-6a2a-46dd-97d5-f11f74c5edee None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:21.752091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6d280757-6a2a-46dd-97d5-f11f74c5edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.764880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1010/1986] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:21.766414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d280757-6a2a-46dd-97d5-f11f74c5edee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.767921 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6d280757-6a2a-46dd-97d5-f11f74c5edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.780953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d280757-6a2a-46dd-97d5-f11f74c5edee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.786687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.787360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.787630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.787903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] PATH_INFO: `/v3/users/c5f816bb835f4c528aa95b2163812d14` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.789075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f816bb835f4c528aa95b2163812d14)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.792774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.839016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 977/1987] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:21 2022] DELETE /identity/v3/users/bbd72c52364e462c818abb8ce067ece8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:21.842006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.842006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.919537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b965942-610a-44e9-8d60-4730b56e3a6f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.924165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19af350-6eac-4b73-b971-6c2f96f8bf87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.924983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19af350-6eac-4b73-b971-6c2f96f8bf87 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.925318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19af350-6eac-4b73-b971-6c2f96f8bf87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.925602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19af350-6eac-4b73-b971-6c2f96f8bf87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.027390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19af350-6eac-4b73-b971-6c2f96f8bf87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:22.029044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19af350-6eac-4b73-b971-6c2f96f8bf87 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.029452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f816bb835f4c528aa95b2163812d14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.030694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f816bb835f4c528aa95b2163812d14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.042984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 978/1988] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:22.044443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cddd0-2f28-4bad-bfc0-fd52a9824e66 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.049475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cddd0-2f28-4bad-bfc0-fd52a9824e66 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.049475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cddd0-2f28-4bad-bfc0-fd52a9824e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.051490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f816bb835f4c528aa95b2163812d14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.070584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c86cddd0-2f28-4bad-bfc0-fd52a9824e66 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:22.071903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c86cddd0-2f28-4bad-bfc0-fd52a9824e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:22.082177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 979/1989] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:22.083188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3018f5-93bf-48f5-878b-1c414f985f21 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.083478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3018f5-93bf-48f5-878b-1c414f985f21 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.083751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3018f5-93bf-48f5-878b-1c414f985f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.105452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4c3018f5-93bf-48f5-878b-1c414f985f21 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:22.107090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4c3018f5-93bf-48f5-878b-1c414f985f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:22.115857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 980/1990] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:22.119075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3018f5-93bf-48f5-878b-1c414f985f21 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:22.129874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3018f5-93bf-48f5-878b-1c414f985f21 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:22.134902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:22.135534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.135819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.136094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.136762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:22.137070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:22.138812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.152695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f816bb835f4c528aa95b2163812d14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.153478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f816bb835f4c528aa95b2163812d14'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.158227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 981/1991] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:22.167319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:22.169465 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:22.183904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268235ba-25df-4434-8cbb-9eca82cfa90a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:22.189220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1011/1992] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:21 2022] DELETE /identity/v3/users/c5f816bb835f4c528aa95b2163812d14 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:22.190848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:22.199815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:22.289781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d2af8-9a43-43ef-9d99-b0e56bdc88e0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:22.294662 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8994b-25af-4fd6-aae6-518abc51575f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:22.295722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8994b-25af-4fd6-aae6-518abc51575f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.297433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8994b-25af-4fd6-aae6-518abc51575f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.297813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8994b-25af-4fd6-aae6-518abc51575f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.303288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-25b8994b-25af-4fd6-aae6-518abc51575f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:22.303437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f7fee-59f8-47db-8611-9bd037f5b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:22.305776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7fee-59f8-47db-8611-9bd037f5b232 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.306090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7fee-59f8-47db-8611-9bd037f5b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.307935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7fee-59f8-47db-8611-9bd037f5b232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.309193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f7fee-59f8-47db-8611-9bd037f5b232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:22.316802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f7fee-59f8-47db-8611-9bd037f5b232 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.322419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8994b-25af-4fd6-aae6-518abc51575f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:22.323972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8994b-25af-4fd6-aae6-518abc51575f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.340216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1012/1993] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:22.430129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 982/1994] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:22 2022] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:22.436029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8994b-25af-4fd6-aae6-518abc51575f service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:22.449337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8994b-25af-4fd6-aae6-518abc51575f service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:22.542408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:22.545377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63b7da-5a5e-48ba-8bdf-f88304f0b818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:22.547452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63b7da-5a5e-48ba-8bdf-f88304f0b818 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.547988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63b7da-5a5e-48ba-8bdf-f88304f0b818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.548363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63b7da-5a5e-48ba-8bdf-f88304f0b818 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.550108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63b7da-5a5e-48ba-8bdf-f88304f0b818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:22.552923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63b7da-5a5e-48ba-8bdf-f88304f0b818 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.658585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1013/1995] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:22 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:22.662816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f7fee-59f8-47db-8611-9bd037f5b232 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:22.677149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f7fee-59f8-47db-8611-9bd037f5b232 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:22.684371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64b81-6f19-4c7f-8845-49b8b892de9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:22.685340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64b81-6f19-4c7f-8845-49b8b892de9e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.685923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64b81-6f19-4c7f-8845-49b8b892de9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.686373 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64b81-6f19-4c7f-8845-49b8b892de9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.687200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde64b81-6f19-4c7f-8845-49b8b892de9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:22.689211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde64b81-6f19-4c7f-8845-49b8b892de9e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.702572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 983/1996] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:22.706128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63b7da-5a5e-48ba-8bdf-f88304f0b818 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:22.721447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63b7da-5a5e-48ba-8bdf-f88304f0b818 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:22.730456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a59e9-3558-4292-880d-18d4643175c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:22.731367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a59e9-3558-4292-880d-18d4643175c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.731957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a59e9-3558-4292-880d-18d4643175c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.733194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a59e9-3558-4292-880d-18d4643175c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.734851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a59e9-3558-4292-880d-18d4643175c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:22.738467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a59e9-3558-4292-880d-18d4643175c8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.765746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1014/1997] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:22.767022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64b81-6f19-4c7f-8845-49b8b892de9e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:22.778833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64b81-6f19-4c7f-8845-49b8b892de9e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:22.784438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2d343-7254-4f33-a5f2-38ba56365ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:22.785116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2d343-7254-4f33-a5f2-38ba56365ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.785402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2d343-7254-4f33-a5f2-38ba56365ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.785822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2d343-7254-4f33-a5f2-38ba56365ff9 admin admin] PATH_INFO: `/v3/projects/6dc8223ac257447dabe7e090b3b6379c/users/9e06a426d6e74031a70a5dd83d196dfa/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.803718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2d343-7254-4f33-a5f2-38ba56365ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc8223ac257447dabe7e090b3b6379c, user_id=9e06a426d6e74031a70a5dd83d196dfa, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:22.807255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2d343-7254-4f33-a5f2-38ba56365ff9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.872925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 984/1998] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:22 2022] PUT /identity/v3/projects/6dc8223ac257447dabe7e090b3b6379c/users/9e06a426d6e74031a70a5dd83d196dfa/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:22.883580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5c802-f3df-4d0b-a365-c0b180007f29 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.883999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5c802-f3df-4d0b-a365-c0b180007f29 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.884318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5c802-f3df-4d0b-a365-c0b180007f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.919105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cfc5c802-f3df-4d0b-a365-c0b180007f29 None None] MFA Rules not processed for user `9e06a426d6e74031a70a5dd83d196dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:22.922268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cfc5c802-f3df-4d0b-a365-c0b180007f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:22.962041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2d343-7254-4f33-a5f2-38ba56365ff9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:22.964730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8ab2d343-7254-4f33-a5f2-38ba56365ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:23.064925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1015/1999] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:23.065939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5c802-f3df-4d0b-a365-c0b180007f29 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.067752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cfc5c802-f3df-4d0b-a365-c0b180007f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:23.082727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:23.114385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2d343-7254-4f33-a5f2-38ba56365ff9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.120173 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.120438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.120834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.121116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] PATH_INFO: `/v3/projects/1ccfb3d86cdf4f4f8e8464ae12968ebb` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.122601 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ccfb3d86cdf4f4f8e8464ae12968ebb)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.124260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.160378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5c802-f3df-4d0b-a365-c0b180007f29 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.166242 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.166913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.167219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.167505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] PATH_INFO: `/v3/projects/6a75c61d9d3547dba9948944ba6b5bda` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.171445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a75c61d9d3547dba9948944ba6b5bda)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.173622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.272679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ccfb3d86cdf4f4f8e8464ae12968ebb', 'request_id': 'req-c264171b-92c0-4030-bd13-d25242e7900e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.292058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ccfb3d86cdf4f4f8e8464ae12968ebb', 'request_id': 'req-c264171b-92c0-4030-bd13-d25242e7900e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.307997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ccfb3d86cdf4f4f8e8464ae12968ebb', 'request_id': 'req-c264171b-92c0-4030-bd13-d25242e7900e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.315712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a75c61d9d3547dba9948944ba6b5bda', 'request_id': 'req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.323410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a75c61d9d3547dba9948944ba6b5bda', 'request_id': 'req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.503737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] The token cache is being invalidate because project 1ccfb3d86cdf4f4f8e8464ae12968ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:23.542713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.542713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.542713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 985/2000] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:22 2022] DELETE /identity/v3/projects/1ccfb3d86cdf4f4f8e8464ae12968ebb => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:23.542713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.542713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:23.580855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264171b-92c0-4030-bd13-d25242e7900e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.636589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.637232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.637520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.637796 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] PATH_INFO: `/v3/projects/83698261a7584eaf9c1385e9c011c4a8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.638977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83698261a7584eaf9c1385e9c011c4a8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.640965 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.729648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a75c61d9d3547dba9948944ba6b5bda', 'request_id': 'req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.746547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] The token cache is being invalidate because project 6a75c61d9d3547dba9948944ba6b5bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:23.746942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.747700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.749600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1016/2001] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:23 2022] DELETE /identity/v3/projects/6a75c61d9d3547dba9948944ba6b5bda => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:23.750796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.754342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:23.760388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83698261a7584eaf9c1385e9c011c4a8', 'request_id': 'req-e6ae43e0-2f95-498b-b524-3ec449238813'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.767342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83698261a7584eaf9c1385e9c011c4a8', 'request_id': 'req-e6ae43e0-2f95-498b-b524-3ec449238813'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.775304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83698261a7584eaf9c1385e9c011c4a8', 'request_id': 'req-e6ae43e0-2f95-498b-b524-3ec449238813'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.811717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b8f5c-6e63-4091-aaaa-5ca77f62eb2d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.831622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] The token cache is being invalidate because project 83698261a7584eaf9c1385e9c011c4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:23.834148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.834148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:23.835160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 986/2002] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:23 2022] DELETE /identity/v3/projects/83698261a7584eaf9c1385e9c011c4a8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:23.839128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.840795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:23.867305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cf070-5127-4075-99ce-267a9bf3fc27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.867939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cf070-5127-4075-99ce-267a9bf3fc27 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.868225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cf070-5127-4075-99ce-267a9bf3fc27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.868503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cf070-5127-4075-99ce-267a9bf3fc27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.871003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-327cf070-5127-4075-99ce-267a9bf3fc27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:23.915888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae43e0-2f95-498b-b524-3ec449238813 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.921344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.922703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.922993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.923270 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] PATH_INFO: `/v3/users/248b5e2fa9534b37850389df1b1d3677` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.925210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] RBAC: Authorizing `identity:delete_user(user_id=248b5e2fa9534b37850389df1b1d3677)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.927237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.950234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cf070-5127-4075-99ce-267a9bf3fc27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.951833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cf070-5127-4075-99ce-267a9bf3fc27 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.962054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1017/2003] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:23.966241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d443c01-a90d-448a-b3c9-923c1c0f9e84 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.966241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d443c01-a90d-448a-b3c9-923c1c0f9e84 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.966241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d443c01-a90d-448a-b3c9-923c1c0f9e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.988221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:23.990727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8d443c01-a90d-448a-b3c9-923c1c0f9e84 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:23.994778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8d443c01-a90d-448a-b3c9-923c1c0f9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.000376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1018/2004] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:24.001796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe7d41-3592-422f-be62-33bcaf555ec9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.002144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe7d41-3592-422f-be62-33bcaf555ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.002382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe7d41-3592-422f-be62-33bcaf555ec9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.003815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1019/2005] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:02:24.004375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe7d41-3592-422f-be62-33bcaf555ec9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.006202 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9abe7d41-3592-422f-be62-33bcaf555ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.022345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe7d41-3592-422f-be62-33bcaf555ec9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.027044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.027670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.027949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.028219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] PATH_INFO: `/v3/users/162f64ad04634c788b29439b96667fa4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.029333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162f64ad04634c788b29439b96667fa4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.031919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.125348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248b5e2fa9534b37850389df1b1d3677'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.125998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248b5e2fa9534b37850389df1b1d3677'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.132648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248b5e2fa9534b37850389df1b1d3677'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.133287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248b5e2fa9534b37850389df1b1d3677'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.150882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248b5e2fa9534b37850389df1b1d3677'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.210249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 987/2006] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:23 2022] DELETE /identity/v3/users/248b5e2fa9534b37850389df1b1d3677 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:24.211254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.212634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.236042 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162f64ad04634c788b29439b96667fa4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.236994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162f64ad04634c788b29439b96667fa4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.244688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162f64ad04634c788b29439b96667fa4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.290065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162f64ad04634c788b29439b96667fa4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.291591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e7eb612e-2484-4d09-be2c-0a72f4d90750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162f64ad04634c788b29439b96667fa4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.317953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1020/2007] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:24 2022] DELETE /identity/v3/users/162f64ad04634c788b29439b96667fa4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:24.317953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df6492-8716-4aaa-ae73-b677f40a6e35 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.317953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df6492-8716-4aaa-ae73-b677f40a6e35 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.317953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df6492-8716-4aaa-ae73-b677f40a6e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.323539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6e0d4-8a28-4031-b0d9-a483c310913d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.339555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-89df6492-8716-4aaa-ae73-b677f40a6e35 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:24.340756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-89df6492-8716-4aaa-ae73-b677f40a6e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.347089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:24.397952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.398784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.399494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.399879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] PATH_INFO: `/v3/users/9e06a426d6e74031a70a5dd83d196dfa` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.401444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e06a426d6e74031a70a5dd83d196dfa)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.403623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.430830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1021/2008] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:24.434291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcef60-b626-42ce-9968-af5945561eab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.434291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcef60-b626-42ce-9968-af5945561eab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.434291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcef60-b626-42ce-9968-af5945561eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.458275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-98dcef60-b626-42ce-9968-af5945561eab None None] MFA Rules not processed for user `efba357340ac47dca0b1742d4e04fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:24.459511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98dcef60-b626-42ce-9968-af5945561eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.541812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1022/2009] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:24.543946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcef60-b626-42ce-9968-af5945561eab None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.546549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98dcef60-b626-42ce-9968-af5945561eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.584654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcef60-b626-42ce-9968-af5945561eab None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.611732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.612399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.612678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.612954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] PATH_INFO: `/v3/users/d8e640ff14a24cb78969f3601ec8f3d0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.620937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e640ff14a24cb78969f3601ec8f3d0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.622711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.658029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e06a426d6e74031a70a5dd83d196dfa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.660053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e06a426d6e74031a70a5dd83d196dfa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.671225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e06a426d6e74031a70a5dd83d196dfa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.672642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e06a426d6e74031a70a5dd83d196dfa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.695251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e06a426d6e74031a70a5dd83d196dfa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.757722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 988/2010] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:24 2022] DELETE /identity/v3/users/9e06a426d6e74031a70a5dd83d196dfa => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:24.760798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.760798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.823687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c573a-a307-4ffd-ad9d-7577c3d3c318 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.829353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468d6f2-cd2e-4ef8-82dc-228cefd8550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.832033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468d6f2-cd2e-4ef8-82dc-228cefd8550e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.832033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468d6f2-cd2e-4ef8-82dc-228cefd8550e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.832033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468d6f2-cd2e-4ef8-82dc-228cefd8550e admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.832033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468d6f2-cd2e-4ef8-82dc-228cefd8550e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:24.832033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468d6f2-cd2e-4ef8-82dc-228cefd8550e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.833349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468d6f2-cd2e-4ef8-82dc-228cefd8550e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.838532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e640ff14a24cb78969f3601ec8f3d0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.839254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e640ff14a24cb78969f3601ec8f3d0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.847402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 989/2011] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:24.848833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c2528-f944-42fd-9d56-d22565fb8313 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.849134 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c2528-f944-42fd-9d56-d22565fb8313 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.849413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c2528-f944-42fd-9d56-d22565fb8313 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.851234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 990/2012] 10.222.0.33 () {54 vars in 961 bytes} [Tue Oct 4 09:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:02:24.852633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c2528-f944-42fd-9d56-d22565fb8313 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.855117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc4c2528-f944-42fd-9d56-d22565fb8313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.856638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e640ff14a24cb78969f3601ec8f3d0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.872457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c2528-f944-42fd-9d56-d22565fb8313 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.877544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.878265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.878549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.878825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] PATH_INFO: `/v3/projects/73fd784be1c84c05bdb546868220d6a2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.879936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fd784be1c84c05bdb546868220d6a2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.881846 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.900877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e640ff14a24cb78969f3601ec8f3d0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.901507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-69baeba1-396b-4336-99a0-91614022e5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e640ff14a24cb78969f3601ec8f3d0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:24.927355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1023/2013] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:24 2022] DELETE /identity/v3/users/d8e640ff14a24cb78969f3601ec8f3d0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:24.928653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f82a0-388c-4b16-b9fb-7e323b559720 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.928942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f82a0-388c-4b16-b9fb-7e323b559720 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.929218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f82a0-388c-4b16-b9fb-7e323b559720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.951173 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-572f82a0-388c-4b16-b9fb-7e323b559720 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:24.952390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-572f82a0-388c-4b16-b9fb-7e323b559720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.012347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fd784be1c84c05bdb546868220d6a2', 'request_id': 'req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.016163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1024/2014] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:25.017027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f82a0-388c-4b16-b9fb-7e323b559720 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.018624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-572f82a0-388c-4b16-b9fb-7e323b559720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.021824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fd784be1c84c05bdb546868220d6a2', 'request_id': 'req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.028253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fd784be1c84c05bdb546868220d6a2', 'request_id': 'req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.031246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f82a0-388c-4b16-b9fb-7e323b559720 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.087646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.088292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.088576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.088869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] PATH_INFO: `/v3/projects/acbcb12b790b478bbf9e56fdc1f2275f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.089971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbcb12b790b478bbf9e56fdc1f2275f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.091929 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.112056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] The token cache is being invalidate because project 73fd784be1c84c05bdb546868220d6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:25.112347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.112987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.114553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 991/2015] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:24 2022] DELETE /identity/v3/projects/73fd784be1c84c05bdb546868220d6a2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:25.115293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.116639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.130436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dffbed-6cd3-4faf-9ff6-fb6502d63328 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.138954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3069b4-681b-4d37-b167-18246024397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.138954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3069b4-681b-4d37-b167-18246024397a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.138954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3069b4-681b-4d37-b167-18246024397a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.138954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3069b4-681b-4d37-b167-18246024397a admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.139347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3069b4-681b-4d37-b167-18246024397a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.139347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3069b4-681b-4d37-b167-18246024397a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.256417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:25.262809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 992/2016] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:25.264378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ebb44-42ed-45dd-82ff-b5cabd97e3f6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.264665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ebb44-42ed-45dd-82ff-b5cabd97e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.264937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ebb44-42ed-45dd-82ff-b5cabd97e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.281306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbcb12b790b478bbf9e56fdc1f2275f', 'request_id': 'req-9a0f9648-43dd-4f61-a0da-4fa13b52860f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.285655 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-897ebb44-42ed-45dd-82ff-b5cabd97e3f6 None None] MFA Rules not processed for user `efba357340ac47dca0b1742d4e04fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:25.289050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-897ebb44-42ed-45dd-82ff-b5cabd97e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.289184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbcb12b790b478bbf9e56fdc1f2275f', 'request_id': 'req-9a0f9648-43dd-4f61-a0da-4fa13b52860f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.351634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:25.355253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 993/2017] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:25.356080 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ebb44-42ed-45dd-82ff-b5cabd97e3f6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.358351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-897ebb44-42ed-45dd-82ff-b5cabd97e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.386756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbcb12b790b478bbf9e56fdc1f2275f', 'request_id': 'req-9a0f9648-43dd-4f61-a0da-4fa13b52860f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.398687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] The token cache is being invalidate because project acbcb12b790b478bbf9e56fdc1f2275f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:25.399163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.399925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9a0f9648-43dd-4f61-a0da-4fa13b52860f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.401662 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1025/2018] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:25 2022] DELETE /identity/v3/projects/acbcb12b790b478bbf9e56fdc1f2275f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:25.403023 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49f0e-9728-4c40-9eaa-539d622e9f7a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.403416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49f0e-9728-4c40-9eaa-539d622e9f7a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.403758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d49f0e-9728-4c40-9eaa-539d622e9f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.422444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ebb44-42ed-45dd-82ff-b5cabd97e3f6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.425412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c0d49f0e-9728-4c40-9eaa-539d622e9f7a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:25.426405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.426723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c0d49f0e-9728-4c40-9eaa-539d622e9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.426956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.427236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.427504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.429206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.491932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1026/2019] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:25.492876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d49f0e-9728-4c40-9eaa-539d622e9f7a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.494252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c0d49f0e-9728-4c40-9eaa-539d622e9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.503385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.504840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.506274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d49f0e-9728-4c40-9eaa-539d622e9f7a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.512410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.513061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.513331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.513606 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] PATH_INFO: `/v3/projects/eadb7754925144e3a850d25bd3271bf9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.515089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 994/2020] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:25.523098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadb7754925144e3a850d25bd3271bf9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.523239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.523239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.523397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.528862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61884a3-e5d3-46d4-be1a-3f7d1400007f service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.535616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da4f29-2290-49eb-905e-0a6db74fb10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.536235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da4f29-2290-49eb-905e-0a6db74fb10c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.536591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da4f29-2290-49eb-905e-0a6db74fb10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.536819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da4f29-2290-49eb-905e-0a6db74fb10c admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.537507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da4f29-2290-49eb-905e-0a6db74fb10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.539509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da4f29-2290-49eb-905e-0a6db74fb10c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.620796 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 995/2021] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:25.620796 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da4f29-2290-49eb-905e-0a6db74fb10c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.622830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-64da4f29-2290-49eb-905e-0a6db74fb10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.633897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadb7754925144e3a850d25bd3271bf9', 'request_id': 'req-f526988e-3740-400a-b0ec-64cc2fc38453'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.638233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da4f29-2290-49eb-905e-0a6db74fb10c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.640987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadb7754925144e3a850d25bd3271bf9', 'request_id': 'req-f526988e-3740-400a-b0ec-64cc2fc38453'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.698855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f914-0abe-4a28-8e1e-dfb2fca118ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.699572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f914-0abe-4a28-8e1e-dfb2fca118ba service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.699941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f914-0abe-4a28-8e1e-dfb2fca118ba service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.700351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f914-0abe-4a28-8e1e-dfb2fca118ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.702260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1608f914-0abe-4a28-8e1e-dfb2fca118ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.715002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f914-0abe-4a28-8e1e-dfb2fca118ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.716587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f914-0abe-4a28-8e1e-dfb2fca118ba service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.724706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadb7754925144e3a850d25bd3271bf9', 'request_id': 'req-f526988e-3740-400a-b0ec-64cc2fc38453'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.727997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 996/2022] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:25.729406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b64e1-5542-4c74-9ab2-0e1deb812743 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.729847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b64e1-5542-4c74-9ab2-0e1deb812743 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.735479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b64e1-5542-4c74-9ab2-0e1deb812743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.747143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] The token cache is being invalidate because project eadb7754925144e3a850d25bd3271bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:25.747447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.748188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f526988e-3740-400a-b0ec-64cc2fc38453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.751491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-658b64e1-5542-4c74-9ab2-0e1deb812743 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:25.752244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-658b64e1-5542-4c74-9ab2-0e1deb812743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.752776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1027/2023] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:25 2022] DELETE /identity/v3/projects/eadb7754925144e3a850d25bd3271bf9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:25.754417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0a623-40e8-4c2c-bc61-a63cee28ae63 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.754704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0a623-40e8-4c2c-bc61-a63cee28ae63 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.754979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0a623-40e8-4c2c-bc61-a63cee28ae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.775977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-54e0a623-40e8-4c2c-bc61-a63cee28ae63 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:25.777006 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-54e0a623-40e8-4c2c-bc61-a63cee28ae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.835921 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 997/2024] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:25.837987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b64e1-5542-4c74-9ab2-0e1deb812743 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.839489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-658b64e1-5542-4c74-9ab2-0e1deb812743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.855076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1028/2025] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:25.857968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b64e1-5542-4c74-9ab2-0e1deb812743 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.859032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88487-8541-4d78-bfe3-302ddd33d993 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.859887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88487-8541-4d78-bfe3-302ddd33d993 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.860811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88487-8541-4d78-bfe3-302ddd33d993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.870554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea2d64-27b2-4062-9306-3e55127a9d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.871374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2d64-27b2-4062-9306-3e55127a9d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.873956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2d64-27b2-4062-9306-3e55127a9d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.873956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2d64-27b2-4062-9306-3e55127a9d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.873956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea2d64-27b2-4062-9306-3e55127a9d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.875761 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea2d64-27b2-4062-9306-3e55127a9d58 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.886911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ddb88487-8541-4d78-bfe3-302ddd33d993 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:25.888333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ddb88487-8541-4d78-bfe3-302ddd33d993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.891084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 998/2026] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:25.892779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00743c-1689-4388-9744-da21aea4f1e6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.893237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00743c-1689-4388-9744-da21aea4f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.896026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00743c-1689-4388-9744-da21aea4f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.899071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1029/2027] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:25.900656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb88487-8541-4d78-bfe3-302ddd33d993 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.914208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb88487-8541-4d78-bfe3-302ddd33d993 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.919815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0f00743c-1689-4388-9744-da21aea4f1e6 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:25.921011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0da75-20a0-4115-898d-e548604a2ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.921247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0f00743c-1689-4388-9744-da21aea4f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.921964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0da75-20a0-4115-898d-e548604a2ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.922360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0da75-20a0-4115-898d-e548604a2ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.922790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0da75-20a0-4115-898d-e548604a2ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.923638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0da75-20a0-4115-898d-e548604a2ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:25.924137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0da75-20a0-4115-898d-e548604a2ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.931410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0da75-20a0-4115-898d-e548604a2ddd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.932905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 999/2028] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:25.934769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00743c-1689-4388-9744-da21aea4f1e6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.945599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00743c-1689-4388-9744-da21aea4f1e6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.946378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1030/2029] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:25.948087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89668-2636-44ba-bbbc-0b49dd75cc7c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.948506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89668-2636-44ba-bbbc-0b49dd75cc7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.948874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f89668-2636-44ba-bbbc-0b49dd75cc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.950908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3f229-4e24-41ab-9f79-4bb0566a596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.951735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3f229-4e24-41ab-9f79-4bb0566a596e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.952089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3f229-4e24-41ab-9f79-4bb0566a596e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.952596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3f229-4e24-41ab-9f79-4bb0566a596e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.953856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3f229-4e24-41ab-9f79-4bb0566a596e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.957160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3f229-4e24-41ab-9f79-4bb0566a596e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.971968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1000/2030] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:25.972589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-12f89668-2636-44ba-bbbc-0b49dd75cc7c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:25.972969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3f229-4e24-41ab-9f79-4bb0566a596e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.974149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12f89668-2636-44ba-bbbc-0b49dd75cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.985653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1031/2031] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:25.985653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89668-2636-44ba-bbbc-0b49dd75cc7c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.997425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f89668-2636-44ba-bbbc-0b49dd75cc7c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.000171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726c171-d24d-4256-a6a7-a7684f3d0601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.000904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c171-d24d-4256-a6a7-a7684f3d0601 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.001243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c171-d24d-4256-a6a7-a7684f3d0601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.001582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c171-d24d-4256-a6a7-a7684f3d0601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.003122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726c171-d24d-4256-a6a7-a7684f3d0601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.006627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726c171-d24d-4256-a6a7-a7684f3d0601 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.009908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3f229-4e24-41ab-9f79-4bb0566a596e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.024666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc1e70-e1ab-4d68-8a4b-f7f64c5b71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.025341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc1e70-e1ab-4d68-8a4b-f7f64c5b71e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.026282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc1e70-e1ab-4d68-8a4b-f7f64c5b71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.026564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc1e70-e1ab-4d68-8a4b-f7f64c5b71e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.027395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc1e70-e1ab-4d68-8a4b-f7f64c5b71e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:26.027824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc1e70-e1ab-4d68-8a4b-f7f64c5b71e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.029442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc1e70-e1ab-4d68-8a4b-f7f64c5b71e0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.044385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1001/2032] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:26.045269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc1e70-e1ab-4d68-8a4b-f7f64c5b71e0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.056234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc1e70-e1ab-4d68-8a4b-f7f64c5b71e0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.062608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae69cc-2fa0-49e0-8199-5cb7bd1b2ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.063558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae69cc-2fa0-49e0-8199-5cb7bd1b2ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.064060 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae69cc-2fa0-49e0-8199-5cb7bd1b2ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.064432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae69cc-2fa0-49e0-8199-5cb7bd1b2ba3 admin admin] PATH_INFO: `/v3/projects/b0ee5a2e648d4a7da7a8e12b3a4de7d7/users/89c63a9f16be44e8887e69e7dfdc4ead/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.097604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1032/2033] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:26.098019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae69cc-2fa0-49e0-8199-5cb7bd1b2ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ee5a2e648d4a7da7a8e12b3a4de7d7, user_id=89c63a9f16be44e8887e69e7dfdc4ead, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.098346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726c171-d24d-4256-a6a7-a7684f3d0601 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.101175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae69cc-2fa0-49e0-8199-5cb7bd1b2ba3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.162238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726c171-d24d-4256-a6a7-a7684f3d0601 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.167069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ba571-a13b-4e52-a864-761dd3868b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.167705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba571-a13b-4e52-a864-761dd3868b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.167985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba571-a13b-4e52-a864-761dd3868b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.168260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ba571-a13b-4e52-a864-761dd3868b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.168911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ba571-a13b-4e52-a864-761dd3868b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:26.169217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ba571-a13b-4e52-a864-761dd3868b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.171340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ba571-a13b-4e52-a864-761dd3868b3f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.183308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1033/2034] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:26.184142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ba571-a13b-4e52-a864-761dd3868b3f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.192736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:26.196855 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ba571-a13b-4e52-a864-761dd3868b3f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.204483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1002/2035] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:26 2022] PUT /identity/v3/projects/b0ee5a2e648d4a7da7a8e12b3a4de7d7/users/89c63a9f16be44e8887e69e7dfdc4ead/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:26.211414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae69cc-2fa0-49e0-8199-5cb7bd1b2ba3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.211414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3eae69cc-2fa0-49e0-8199-5cb7bd1b2ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:26.262039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef09f36-49e6-4f1d-8c10-70069ae9b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.262681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef09f36-49e6-4f1d-8c10-70069ae9b882 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.263000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef09f36-49e6-4f1d-8c10-70069ae9b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.263272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef09f36-49e6-4f1d-8c10-70069ae9b882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.263902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef09f36-49e6-4f1d-8c10-70069ae9b882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.266572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef09f36-49e6-4f1d-8c10-70069ae9b882 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.275358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae69cc-2fa0-49e0-8199-5cb7bd1b2ba3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.280494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.281184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.281518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.281804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] PATH_INFO: `/v3/projects/6dc8223ac257447dabe7e090b3b6379c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.283448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc8223ac257447dabe7e090b3b6379c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.285873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:26.287126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.364904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1034/2036] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:26 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:26.365719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef09f36-49e6-4f1d-8c10-70069ae9b882 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.415044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc8223ac257447dabe7e090b3b6379c', 'request_id': 'req-b13558bb-9eba-4909-b55b-c43521a98d3b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.421179 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc8223ac257447dabe7e090b3b6379c', 'request_id': 'req-b13558bb-9eba-4909-b55b-c43521a98d3b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.425458 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef09f36-49e6-4f1d-8c10-70069ae9b882 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.427015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc8223ac257447dabe7e090b3b6379c', 'request_id': 'req-b13558bb-9eba-4909-b55b-c43521a98d3b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.481691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e383119-a941-40f6-9517-9da374f4050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.482531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e383119-a941-40f6-9517-9da374f4050d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.482819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e383119-a941-40f6-9517-9da374f4050d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.483100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e383119-a941-40f6-9517-9da374f4050d admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.483797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e383119-a941-40f6-9517-9da374f4050d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.485910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e383119-a941-40f6-9517-9da374f4050d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.512996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] The token cache is being invalidate because project 6dc8223ac257447dabe7e090b3b6379c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:26.513297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.513967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.516097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1003/2037] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:26 2022] DELETE /identity/v3/projects/6dc8223ac257447dabe7e090b3b6379c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:26.516936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.518362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:26.531540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13558bb-9eba-4909-b55b-c43521a98d3b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.536874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed60737-e26c-45b7-b257-8de141e300db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.537468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed60737-e26c-45b7-b257-8de141e300db admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.538110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed60737-e26c-45b7-b257-8de141e300db admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.541981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed60737-e26c-45b7-b257-8de141e300db admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.541981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed60737-e26c-45b7-b257-8de141e300db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.541981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed60737-e26c-45b7-b257-8de141e300db admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.558563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1035/2038] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:26 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:26.559884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835399d5-40ab-4f2c-a339-d2bf2bb45733 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.560175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835399d5-40ab-4f2c-a339-d2bf2bb45733 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.560452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835399d5-40ab-4f2c-a339-d2bf2bb45733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.590183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-835399d5-40ab-4f2c-a339-d2bf2bb45733 None None] MFA Rules not processed for user `89c63a9f16be44e8887e69e7dfdc4ead`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:26.591429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-835399d5-40ab-4f2c-a339-d2bf2bb45733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:26.646228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1004/2039] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:26 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:26.647428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed60737-e26c-45b7-b257-8de141e300db admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.649051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8ed60737-e26c-45b7-b257-8de141e300db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:26.662348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1036/2040] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:26.663954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fbefb-efa9-4c5d-88ae-89b9df8db5d3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.664307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fbefb-efa9-4c5d-88ae-89b9df8db5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.665187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fbefb-efa9-4c5d-88ae-89b9df8db5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.685296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e24fbefb-efa9-4c5d-88ae-89b9df8db5d3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:26.686555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e24fbefb-efa9-4c5d-88ae-89b9df8db5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:26.714488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed60737-e26c-45b7-b257-8de141e300db admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.719814 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9036d-0865-4d86-9c2f-353c6da19c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.720437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9036d-0865-4d86-9c2f-353c6da19c58 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.720720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9036d-0865-4d86-9c2f-353c6da19c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.721598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9036d-0865-4d86-9c2f-353c6da19c58 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.721730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9036d-0865-4d86-9c2f-353c6da19c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.723639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9036d-0865-4d86-9c2f-353c6da19c58 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.746961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1037/2041] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:26.748067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fbefb-efa9-4c5d-88ae-89b9df8db5d3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.749315 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e24fbefb-efa9-4c5d-88ae-89b9df8db5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:26.761358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fbefb-efa9-4c5d-88ae-89b9df8db5d3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.766256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc665d-c382-4031-b5f5-c547f96607ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.767338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc665d-c382-4031-b5f5-c547f96607ce admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.767338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc665d-c382-4031-b5f5-c547f96607ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.767520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc665d-c382-4031-b5f5-c547f96607ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.768094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc665d-c382-4031-b5f5-c547f96607ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.769722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc665d-c382-4031-b5f5-c547f96607ce admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.779464 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1038/2042] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:26.780225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc665d-c382-4031-b5f5-c547f96607ce admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.789459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc665d-c382-4031-b5f5-c547f96607ce admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.793992 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f978b27-e3fc-45b5-af23-a27a7c84d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.795796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f978b27-e3fc-45b5-af23-a27a7c84d18c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.795796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f978b27-e3fc-45b5-af23-a27a7c84d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.795796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f978b27-e3fc-45b5-af23-a27a7c84d18c admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.795796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f978b27-e3fc-45b5-af23-a27a7c84d18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.798017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f978b27-e3fc-45b5-af23-a27a7c84d18c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.849210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1005/2043] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:26 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:26.850074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9036d-0865-4d86-9c2f-353c6da19c58 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.851645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cfe9036d-0865-4d86-9c2f-353c6da19c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:26.897883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1039/2044] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:26 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:26.897883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e47a-1cec-4178-9e89-a84a5797f16c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.897883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e47a-1cec-4178-9e89-a84a5797f16c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.897883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e47a-1cec-4178-9e89-a84a5797f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.910489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9036d-0865-4d86-9c2f-353c6da19c58 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.912952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=1,keystone:DELETE=9,keystone:SELECT=90 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:26.914792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b0fee-7eb1-4fd8-90c7-d3af6d31b5a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.915491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b0fee-7eb1-4fd8-90c7-d3af6d31b5a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.915734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b0fee-7eb1-4fd8-90c7-d3af6d31b5a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.916005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b0fee-7eb1-4fd8-90c7-d3af6d31b5a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.918372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2a91e47a-1cec-4178-9e89-a84a5797f16c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:26.919670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2a91e47a-1cec-4178-9e89-a84a5797f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:26.928429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1040/2045] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:26.929491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e47a-1cec-4178-9e89-a84a5797f16c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.940457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e47a-1cec-4178-9e89-a84a5797f16c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.944883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:26.945358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0199a-d917-4e0d-9c57-a1c8a0e8cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.945967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0199a-d917-4e0d-9c57-a1c8a0e8cf9f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.946312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0199a-d917-4e0d-9c57-a1c8a0e8cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.946592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0199a-d917-4e0d-9c57-a1c8a0e8cf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.947250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0199a-d917-4e0d-9c57-a1c8a0e8cf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.948892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0199a-d917-4e0d-9c57-a1c8a0e8cf9f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.959208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1041/2046] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:26.960252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0199a-d917-4e0d-9c57-a1c8a0e8cf9f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.971122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0199a-d917-4e0d-9c57-a1c8a0e8cf9f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.976388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3c607-c772-4189-93bf-e9627da318ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.976976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3c607-c772-4189-93bf-e9627da318ff admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.977253 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3c607-c772-4189-93bf-e9627da318ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.977524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3c607-c772-4189-93bf-e9627da318ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.978190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3c607-c772-4189-93bf-e9627da318ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.979776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3c607-c772-4189-93bf-e9627da318ff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.981145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b0fee-7eb1-4fd8-90c7-d3af6d31b5a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.983915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b0fee-7eb1-4fd8-90c7-d3af6d31b5a5 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.990419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1042/2047] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:26.991215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3c607-c772-4189-93bf-e9627da318ff admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.992474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1006/2048] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:26.993156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b0fee-7eb1-4fd8-90c7-d3af6d31b5a5 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.000941 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3c607-c772-4189-93bf-e9627da318ff admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.003597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b0fee-7eb1-4fd8-90c7-d3af6d31b5a5 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.005767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ebc64-6fad-4440-98c6-c1bf53a338f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.006422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ebc64-6fad-4440-98c6-c1bf53a338f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.006703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ebc64-6fad-4440-98c6-c1bf53a338f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.006975 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ebc64-6fad-4440-98c6-c1bf53a338f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.008116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ebc64-6fad-4440-98c6-c1bf53a338f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.009356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ebc64-6fad-4440-98c6-c1bf53a338f3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.009546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0faa2b-8e61-4a4b-9780-53db42939f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.010139 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0faa2b-8e61-4a4b-9780-53db42939f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.010428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0faa2b-8e61-4a4b-9780-53db42939f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.010742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0faa2b-8e61-4a4b-9780-53db42939f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.011644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0faa2b-8e61-4a4b-9780-53db42939f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:27.011644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0faa2b-8e61-4a4b-9780-53db42939f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.013208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0faa2b-8e61-4a4b-9780-53db42939f3d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.021164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1043/2049] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:27.022124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ebc64-6fad-4440-98c6-c1bf53a338f3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.028232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1007/2050] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:27.028232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0faa2b-8e61-4a4b-9780-53db42939f3d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.034139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ebc64-6fad-4440-98c6-c1bf53a338f3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.040042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0faa2b-8e61-4a4b-9780-53db42939f3d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.040335 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756ac4d-6999-426d-85ad-3011bbc4e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.041122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756ac4d-6999-426d-85ad-3011bbc4e48c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.041637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756ac4d-6999-426d-85ad-3011bbc4e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.042056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756ac4d-6999-426d-85ad-3011bbc4e48c admin admin] PATH_INFO: `/v3/projects/48a534fe86b7440ea806522752cd0de0/users/de92c789da16429892e1c2031931e242/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.047165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072c566-f857-4146-bdd8-84d168e510d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.047165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072c566-f857-4146-bdd8-84d168e510d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.047165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072c566-f857-4146-bdd8-84d168e510d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.047165 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072c566-f857-4146-bdd8-84d168e510d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.047506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072c566-f857-4146-bdd8-84d168e510d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.048875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072c566-f857-4146-bdd8-84d168e510d3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.058899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756ac4d-6999-426d-85ad-3011bbc4e48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a534fe86b7440ea806522752cd0de0, user_id=de92c789da16429892e1c2031931e242, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.060622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1008/2051] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:27.061305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072c566-f857-4146-bdd8-84d168e510d3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.063142 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1072c566-f857-4146-bdd8-84d168e510d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.065388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756ac4d-6999-426d-85ad-3011bbc4e48c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.086540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072c566-f857-4146-bdd8-84d168e510d3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.086540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.086540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.086540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.086887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] PATH_INFO: `/v3/users/89c63a9f16be44e8887e69e7dfdc4ead` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.086887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c63a9f16be44e8887e69e7dfdc4ead)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.086887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.106958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:27.140937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1044/2052] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:27 2022] PUT /identity/v3/projects/48a534fe86b7440ea806522752cd0de0/users/de92c789da16429892e1c2031931e242/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:27.145228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756ac4d-6999-426d-85ad-3011bbc4e48c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.158395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:27.210017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756ac4d-6999-426d-85ad-3011bbc4e48c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.216763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53828-0f1c-402f-8356-509e6617e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.216763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53828-0f1c-402f-8356-509e6617e2de admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.216763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53828-0f1c-402f-8356-509e6617e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.216763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53828-0f1c-402f-8356-509e6617e2de admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.217152 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b53828-0f1c-402f-8356-509e6617e2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.218694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b53828-0f1c-402f-8356-509e6617e2de admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.228906 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1045/2053] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:27.229725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53828-0f1c-402f-8356-509e6617e2de admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.242749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53828-0f1c-402f-8356-509e6617e2de admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.247706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275fa9c-6d9a-4796-a480-6c7a15e4cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.248569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275fa9c-6d9a-4796-a480-6c7a15e4cb10 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.249140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275fa9c-6d9a-4796-a480-6c7a15e4cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.249439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275fa9c-6d9a-4796-a480-6c7a15e4cb10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.250127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275fa9c-6d9a-4796-a480-6c7a15e4cb10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.252129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275fa9c-6d9a-4796-a480-6c7a15e4cb10 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.276793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c63a9f16be44e8887e69e7dfdc4ead'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:27.277498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c63a9f16be44e8887e69e7dfdc4ead'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:27.285076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c63a9f16be44e8887e69e7dfdc4ead'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:27.285789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c63a9f16be44e8887e69e7dfdc4ead'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:27.298361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6cbf6d7e-fac9-4ea6-8730-76a4784946ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c63a9f16be44e8887e69e7dfdc4ead'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:27.353233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1046/2054] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:27.354212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275fa9c-6d9a-4796-a480-6c7a15e4cb10 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.355815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2275fa9c-6d9a-4796-a480-6c7a15e4cb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.409109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1009/2055] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:27 2022] DELETE /identity/v3/users/89c63a9f16be44e8887e69e7dfdc4ead => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:27.410410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44321a-b440-461a-9cac-657355ec6c34 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.410695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44321a-b440-461a-9cac-657355ec6c34 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.410970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44321a-b440-461a-9cac-657355ec6c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.417856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275fa9c-6d9a-4796-a480-6c7a15e4cb10 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.439247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dc44321a-b440-461a-9cac-657355ec6c34 None None] MFA Rules not processed for user `de92c789da16429892e1c2031931e242`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:27.440488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dc44321a-b440-461a-9cac-657355ec6c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.475560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7cb98-3ba3-4af8-9607-95e5891e00ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.476197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7cb98-3ba3-4af8-9607-95e5891e00ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.476513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7cb98-3ba3-4af8-9607-95e5891e00ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.476790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7cb98-3ba3-4af8-9607-95e5891e00ba admin admin] PATH_INFO: `/v3/projects/efa91acb392b40ccbbdd624022f4ec6c/users/44262a9625454163879681b45f56c5e6/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.491311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7cb98-3ba3-4af8-9607-95e5891e00ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa91acb392b40ccbbdd624022f4ec6c, user_id=44262a9625454163879681b45f56c5e6, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.494043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7cb98-3ba3-4af8-9607-95e5891e00ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.505055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1010/2056] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:27.506069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44321a-b440-461a-9cac-657355ec6c34 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.507427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dc44321a-b440-461a-9cac-657355ec6c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.520821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44321a-b440-461a-9cac-657355ec6c34 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.525781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03ba22-0f25-4bb7-9d1d-d88d1c503207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.526450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ba22-0f25-4bb7-9d1d-d88d1c503207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.526730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ba22-0f25-4bb7-9d1d-d88d1c503207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.527004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ba22-0f25-4bb7-9d1d-d88d1c503207 admin admin] PATH_INFO: `/v3/projects/5e7e571271824d3db6930eb4158a5d88/users/a7120d37c24a48518e9b04c1c119eba5/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.543792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03ba22-0f25-4bb7-9d1d-d88d1c503207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7e571271824d3db6930eb4158a5d88, user_id=a7120d37c24a48518e9b04c1c119eba5, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.546742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03ba22-0f25-4bb7-9d1d-d88d1c503207 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.553430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1047/2057] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:27 2022] PUT /identity/v3/projects/efa91acb392b40ccbbdd624022f4ec6c/users/44262a9625454163879681b45f56c5e6/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:27.554474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7cb98-3ba3-4af8-9607-95e5891e00ba admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.556271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bff7cb98-3ba3-4af8-9607-95e5891e00ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.621993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1011/2058] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:27 2022] PUT /identity/v3/projects/5e7e571271824d3db6930eb4158a5d88/users/a7120d37c24a48518e9b04c1c119eba5/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:27.628161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ae22-2959-431b-a0f9-c0828433e36d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.628161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ae22-2959-431b-a0f9-c0828433e36d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.628161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ae22-2959-431b-a0f9-c0828433e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.628469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7cb98-3ba3-4af8-9607-95e5891e00ba admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.629661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:27.646033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7e17ae22-2959-431b-a0f9-c0828433e36d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:27.647255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7e17ae22-2959-431b-a0f9-c0828433e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.674984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:27.691551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5541346-3e42-43f8-8d6e-688f8f300a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.692172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541346-3e42-43f8-8d6e-688f8f300a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.692460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541346-3e42-43f8-8d6e-688f8f300a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.692735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541346-3e42-43f8-8d6e-688f8f300a47 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.693376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5541346-3e42-43f8-8d6e-688f8f300a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.695332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5541346-3e42-43f8-8d6e-688f8f300a47 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.715358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1012/2059] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:27.718944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17ae22-2959-431b-a0f9-c0828433e36d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.718944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7e17ae22-2959-431b-a0f9-c0828433e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.729429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17ae22-2959-431b-a0f9-c0828433e36d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.733930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179df8db-79ea-4490-b6ea-54497fd34379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.737285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df8db-79ea-4490-b6ea-54497fd34379 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.737285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df8db-79ea-4490-b6ea-54497fd34379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.737285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179df8db-79ea-4490-b6ea-54497fd34379 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.737285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179df8db-79ea-4490-b6ea-54497fd34379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.737613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179df8db-79ea-4490-b6ea-54497fd34379 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.794239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1048/2060] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:27.794239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1fabe-6740-4ab4-91f9-277c7097cc3d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.794239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1fabe-6740-4ab4-91f9-277c7097cc3d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.794239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1fabe-6740-4ab4-91f9-277c7097cc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.821375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-18a1fabe-6740-4ab4-91f9-277c7097cc3d None None] MFA Rules not processed for user `44262a9625454163879681b45f56c5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:27.821775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1013/2061] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:27.822729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18a1fabe-6740-4ab4-91f9-277c7097cc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.822961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd9e37-db90-44dd-afe6-e62dd1adcfbe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.823250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd9e37-db90-44dd-afe6-e62dd1adcfbe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.823525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd9e37-db90-44dd-afe6-e62dd1adcfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.842687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9bfd9e37-db90-44dd-afe6-e62dd1adcfbe None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:27.843907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9bfd9e37-db90-44dd-afe6-e62dd1adcfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.886647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1049/2062] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:27.887663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1fabe-6740-4ab4-91f9-277c7097cc3d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.889416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18a1fabe-6740-4ab4-91f9-277c7097cc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.902753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1014/2063] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:27.906483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd9e37-db90-44dd-afe6-e62dd1adcfbe None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.906483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9bfd9e37-db90-44dd-afe6-e62dd1adcfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.926055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:27.947338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1fabe-6740-4ab4-91f9-277c7097cc3d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.951086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115beb7-c4e3-4103-8ccb-cce2798075bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.951691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115beb7-c4e3-4103-8ccb-cce2798075bc service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.951974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115beb7-c4e3-4103-8ccb-cce2798075bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.952246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115beb7-c4e3-4103-8ccb-cce2798075bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.954567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c115beb7-c4e3-4103-8ccb-cce2798075bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.965989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd9e37-db90-44dd-afe6-e62dd1adcfbe None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.969747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453bcbb-60b6-4f6e-ad6a-57d344819f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.970396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453bcbb-60b6-4f6e-ad6a-57d344819f85 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.970680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453bcbb-60b6-4f6e-ad6a-57d344819f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.970959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453bcbb-60b6-4f6e-ad6a-57d344819f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.980221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453bcbb-60b6-4f6e-ad6a-57d344819f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.980895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:27.981604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453bcbb-60b6-4f6e-ad6a-57d344819f85 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.991538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1015/2064] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:27.992348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453bcbb-60b6-4f6e-ad6a-57d344819f85 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.002396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453bcbb-60b6-4f6e-ad6a-57d344819f85 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.007535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b43c0-2875-4298-8d9e-a99e27005f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.008114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b43c0-2875-4298-8d9e-a99e27005f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.008403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b43c0-2875-4298-8d9e-a99e27005f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.009214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b43c0-2875-4298-8d9e-a99e27005f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.009712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b43c0-2875-4298-8d9e-a99e27005f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.012088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b43c0-2875-4298-8d9e-a99e27005f87 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.020673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115beb7-c4e3-4103-8ccb-cce2798075bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.022283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115beb7-c4e3-4103-8ccb-cce2798075bc service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.026765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1016/2065] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:28.026765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b43c0-2875-4298-8d9e-a99e27005f87 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.033278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1050/2066] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:28.034109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115beb7-c4e3-4103-8ccb-cce2798075bc service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.040740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b43c0-2875-4298-8d9e-a99e27005f87 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.046467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115beb7-c4e3-4103-8ccb-cce2798075bc service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.046929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea566c9-9761-43e6-adb1-69c8c8901cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.054189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea566c9-9761-43e6-adb1-69c8c8901cda admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.054189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea566c9-9761-43e6-adb1-69c8c8901cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.054189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea566c9-9761-43e6-adb1-69c8c8901cda admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.054189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea566c9-9761-43e6-adb1-69c8c8901cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.054189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea566c9-9761-43e6-adb1-69c8c8901cda admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.054580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd796-5b5d-4f24-92ba-93720f2eafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.054763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd796-5b5d-4f24-92ba-93720f2eafdc admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.055036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd796-5b5d-4f24-92ba-93720f2eafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.055314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd796-5b5d-4f24-92ba-93720f2eafdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.056016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cd796-5b5d-4f24-92ba-93720f2eafdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.058399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cd796-5b5d-4f24-92ba-93720f2eafdc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.161356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1017/2067] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:28 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:28.162349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea566c9-9761-43e6-adb1-69c8c8901cda admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.163231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1051/2068] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:28 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:28.164160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd796-5b5d-4f24-92ba-93720f2eafdc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.175726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea566c9-9761-43e6-adb1-69c8c8901cda admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.231738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:28.244640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:28.250275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd796-5b5d-4f24-92ba-93720f2eafdc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.255409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0fc57-3b63-4f1e-81e9-59eb7e82a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.256021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0fc57-3b63-4f1e-81e9-59eb7e82a520 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.256308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0fc57-3b63-4f1e-81e9-59eb7e82a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.256590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0fc57-3b63-4f1e-81e9-59eb7e82a520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.257261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0fc57-3b63-4f1e-81e9-59eb7e82a520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.258951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0fc57-3b63-4f1e-81e9-59eb7e82a520 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.275604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b39d9-3f99-442a-904f-3a1f1fc94584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.276632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b39d9-3f99-442a-904f-3a1f1fc94584 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.276842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b39d9-3f99-442a-904f-3a1f1fc94584 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.277307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b39d9-3f99-442a-904f-3a1f1fc94584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.278422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1052/2069] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:28.280000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0fc57-3b63-4f1e-81e9-59eb7e82a520 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.293125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0fc57-3b63-4f1e-81e9-59eb7e82a520 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.300188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b91f9-bbf1-4a6f-a3cb-de9341f24bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.301694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b91f9-bbf1-4a6f-a3cb-de9341f24bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.302224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b91f9-bbf1-4a6f-a3cb-de9341f24bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.302725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b91f9-bbf1-4a6f-a3cb-de9341f24bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.304126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b91f9-bbf1-4a6f-a3cb-de9341f24bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.306569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b91f9-bbf1-4a6f-a3cb-de9341f24bc0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.313688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b39d9-3f99-442a-904f-3a1f1fc94584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.315755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b39d9-3f99-442a-904f-3a1f1fc94584 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.321526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1053/2070] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:28.322699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b91f9-bbf1-4a6f-a3cb-de9341f24bc0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.331711 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1018/2071] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:28.332694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b39d9-3f99-442a-904f-3a1f1fc94584 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.345863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b39d9-3f99-442a-904f-3a1f1fc94584 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.351222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b91f9-bbf1-4a6f-a3cb-de9341f24bc0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.352208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49591a-64f3-46a2-894e-b463e2e497c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.352890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49591a-64f3-46a2-894e-b463e2e497c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.353175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49591a-64f3-46a2-894e-b463e2e497c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.353453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49591a-64f3-46a2-894e-b463e2e497c9 admin admin] PATH_INFO: `/v3/projects/216d3c48ece34377a23750be97173a76/users/7d60c94216a14fd6b5fbe513fb79559d/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.365962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97418316-ef17-4828-a4a0-e44c1515f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.366777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97418316-ef17-4828-a4a0-e44c1515f8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.367147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97418316-ef17-4828-a4a0-e44c1515f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.367525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97418316-ef17-4828-a4a0-e44c1515f8fa admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.368388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97418316-ef17-4828-a4a0-e44c1515f8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.370487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97418316-ef17-4828-a4a0-e44c1515f8fa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.372788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49591a-64f3-46a2-894e-b463e2e497c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216d3c48ece34377a23750be97173a76, user_id=7d60c94216a14fd6b5fbe513fb79559d, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.376156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49591a-64f3-46a2-894e-b463e2e497c9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.459804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1054/2072] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:28 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:28.459804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97418316-ef17-4828-a4a0-e44c1515f8fa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.472971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97418316-ef17-4828-a4a0-e44c1515f8fa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.488195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1019/2073] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:28 2022] PUT /identity/v3/projects/216d3c48ece34377a23750be97173a76/users/7d60c94216a14fd6b5fbe513fb79559d/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:28.489215 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49591a-64f3-46a2-894e-b463e2e497c9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.491022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b49591a-64f3-46a2-894e-b463e2e497c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:28.537068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:28.557685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea20eb1-f277-499c-b8fc-d63929e9153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.558386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20eb1-f277-499c-b8fc-d63929e9153e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.558668 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20eb1-f277-499c-b8fc-d63929e9153e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.558998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20eb1-f277-499c-b8fc-d63929e9153e admin admin] PATH_INFO: `/v3/projects/5b779f650f7041d2aa37b01f10c69118/users/c972f88ff26c448c9988be9976a16c7d/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.561573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49591a-64f3-46a2-894e-b463e2e497c9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.566589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.567087 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.567367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.567648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] PATH_INFO: `/v3/projects/b0ee5a2e648d4a7da7a8e12b3a4de7d7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.568788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ee5a2e648d4a7da7a8e12b3a4de7d7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.570812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.575120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea20eb1-f277-499c-b8fc-d63929e9153e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b779f650f7041d2aa37b01f10c69118, user_id=c972f88ff26c448c9988be9976a16c7d, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.578302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea20eb1-f277-499c-b8fc-d63929e9153e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.666954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:28.673389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1055/2074] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:28 2022] PUT /identity/v3/projects/5b779f650f7041d2aa37b01f10c69118/users/c972f88ff26c448c9988be9976a16c7d/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:28.674629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea20eb1-f277-499c-b8fc-d63929e9153e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.744917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea20eb1-f277-499c-b8fc-d63929e9153e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.768392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ee5a2e648d4a7da7a8e12b3a4de7d7', 'request_id': 'req-2ba4988c-cc74-4f65-8228-3d8da0322932'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.775522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ee5a2e648d4a7da7a8e12b3a4de7d7', 'request_id': 'req-2ba4988c-cc74-4f65-8228-3d8da0322932'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.784990 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ee5a2e648d4a7da7a8e12b3a4de7d7', 'request_id': 'req-2ba4988c-cc74-4f65-8228-3d8da0322932'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.815294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63862fb-d680-46cd-9354-d9ba6c6f1d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.815904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63862fb-d680-46cd-9354-d9ba6c6f1d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.816213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63862fb-d680-46cd-9354-d9ba6c6f1d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.816487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63862fb-d680-46cd-9354-d9ba6c6f1d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.817134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63862fb-d680-46cd-9354-d9ba6c6f1d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.818918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63862fb-d680-46cd-9354-d9ba6c6f1d0a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.834037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1056/2075] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:28.834037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd897b-6dab-48bc-8580-890cecb49203 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.834037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd897b-6dab-48bc-8580-890cecb49203 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.834037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd897b-6dab-48bc-8580-890cecb49203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.860646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] The token cache is being invalidate because project b0ee5a2e648d4a7da7a8e12b3a4de7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:28.866236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.866347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-aabd897b-6dab-48bc-8580-890cecb49203 None None] MFA Rules not processed for user `7d60c94216a14fd6b5fbe513fb79559d`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:28.866428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.866516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aabd897b-6dab-48bc-8580-890cecb49203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:28.866592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1020/2076] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:28 2022] DELETE /identity/v3/projects/b0ee5a2e648d4a7da7a8e12b3a4de7d7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:28.866592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.866592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:28.877594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4988c-cc74-4f65-8228-3d8da0322932 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.883011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05469aa1-764f-4d70-8a6e-3c743fcdf3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.883707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05469aa1-764f-4d70-8a6e-3c743fcdf3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.884067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05469aa1-764f-4d70-8a6e-3c743fcdf3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.884510 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05469aa1-764f-4d70-8a6e-3c743fcdf3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.885233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05469aa1-764f-4d70-8a6e-3c743fcdf3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.887192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05469aa1-764f-4d70-8a6e-3c743fcdf3f3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.902390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1021/2077] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:28.902390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05469aa1-764f-4d70-8a6e-3c743fcdf3f3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.902784 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05469aa1-764f-4d70-8a6e-3c743fcdf3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:28.916162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05469aa1-764f-4d70-8a6e-3c743fcdf3f3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.922340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019e501-8b4b-4727-8b77-325b8b3201d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.923298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019e501-8b4b-4727-8b77-325b8b3201d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.923764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019e501-8b4b-4727-8b77-325b8b3201d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.924190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019e501-8b4b-4727-8b77-325b8b3201d7 admin admin] PATH_INFO: `/v3/projects/b0ce1aafd8b64a1f838ebe4755233d80/users/29879240d90c4d05b4df714d97edd5ac/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.942582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1057/2078] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:28.951480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab37ae-81f6-4bb6-9265-f00c199c0f27 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.952021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab37ae-81f6-4bb6-9265-f00c199c0f27 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.952021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab37ae-81f6-4bb6-9265-f00c199c0f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.953609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019e501-8b4b-4727-8b77-325b8b3201d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ce1aafd8b64a1f838ebe4755233d80, user_id=29879240d90c4d05b4df714d97edd5ac, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.956336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019e501-8b4b-4727-8b77-325b8b3201d7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.986367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-10ab37ae-81f6-4bb6-9265-f00c199c0f27 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:28.988011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-10ab37ae-81f6-4bb6-9265-f00c199c0f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:28.997055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1058/2079] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:28.997946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab37ae-81f6-4bb6-9265-f00c199c0f27 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.009460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab37ae-81f6-4bb6-9265-f00c199c0f27 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.016362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74925c-58ec-4c4b-acc0-a401b64e7929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.017031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74925c-58ec-4c4b-acc0-a401b64e7929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.017416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74925c-58ec-4c4b-acc0-a401b64e7929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.017596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74925c-58ec-4c4b-acc0-a401b64e7929 admin admin] PATH_INFO: `/v3/projects/5b779f650f7041d2aa37b01f10c69118/users/c972f88ff26c448c9988be9976a16c7d/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.019863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74925c-58ec-4c4b-acc0-a401b64e7929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b779f650f7041d2aa37b01f10c69118, user_id=c972f88ff26c448c9988be9976a16c7d, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.022565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74925c-58ec-4c4b-acc0-a401b64e7929 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.034283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1059/2080] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:28 2022] PUT /identity/v3/projects/5b779f650f7041d2aa37b01f10c69118/users/c972f88ff26c448c9988be9976a16c7d/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:29.035135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74925c-58ec-4c4b-acc0-a401b64e7929 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.036814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df74925c-58ec-4c4b-acc0-a401b64e7929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:29.059193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1022/2081] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:28 2022] PUT /identity/v3/projects/b0ce1aafd8b64a1f838ebe4755233d80/users/29879240d90c4d05b4df714d97edd5ac/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:29.059395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7e089-f6fc-41f8-ab44-dbb515b2ff73 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.059655 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7e089-f6fc-41f8-ab44-dbb515b2ff73 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.059938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7e089-f6fc-41f8-ab44-dbb515b2ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.085142 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7de7e089-f6fc-41f8-ab44-dbb515b2ff73 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:29.086475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7de7e089-f6fc-41f8-ab44-dbb515b2ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:29.101470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74925c-58ec-4c4b-acc0-a401b64e7929 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.153825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:29.157337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1023/2082] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:29.164970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fdc35-0e2d-4529-b382-28e733c79f98 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.164970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fdc35-0e2d-4529-b382-28e733c79f98 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.164970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fdc35-0e2d-4529-b382-28e733c79f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.165241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17d428-f2d6-4ad1-97ff-b4050ba8ca1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.165619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17d428-f2d6-4ad1-97ff-b4050ba8ca1d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.165897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17d428-f2d6-4ad1-97ff-b4050ba8ca1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.166197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17d428-f2d6-4ad1-97ff-b4050ba8ca1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.187367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bb3fdc35-0e2d-4529-b382-28e733c79f98 None None] MFA Rules not processed for user `c972f88ff26c448c9988be9976a16c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:29.188577 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb3fdc35-0e2d-4529-b382-28e733c79f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:29.225819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17d428-f2d6-4ad1-97ff-b4050ba8ca1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.227295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17d428-f2d6-4ad1-97ff-b4050ba8ca1d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.236297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1060/2083] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:29.237107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17d428-f2d6-4ad1-97ff-b4050ba8ca1d service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.251091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17d428-f2d6-4ad1-97ff-b4050ba8ca1d service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.253361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9246d0-55b8-4add-b32c-d5654ed71615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.253962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9246d0-55b8-4add-b32c-d5654ed71615 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.254275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9246d0-55b8-4add-b32c-d5654ed71615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.254547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9246d0-55b8-4add-b32c-d5654ed71615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.255190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9246d0-55b8-4add-b32c-d5654ed71615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.256774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9246d0-55b8-4add-b32c-d5654ed71615 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.262642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1024/2084] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:29.262642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fdc35-0e2d-4529-b382-28e733c79f98 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.268693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1061/2085] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:29.272444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9246d0-55b8-4add-b32c-d5654ed71615 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.280030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fdc35-0e2d-4529-b382-28e733c79f98 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.280629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.281238 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.281518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.281929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.282624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:29.282928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.284586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.284813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9246d0-55b8-4add-b32c-d5654ed71615 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.291074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf52fc-212b-4272-8bb4-bcc66c622265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.291846 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf52fc-212b-4272-8bb4-bcc66c622265 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.292200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf52fc-212b-4272-8bb4-bcc66c622265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.292559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf52fc-212b-4272-8bb4-bcc66c622265 admin admin] PATH_INFO: `/v3/projects/b0ce1aafd8b64a1f838ebe4755233d80/users/29879240d90c4d05b4df714d97edd5ac/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.294670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf52fc-212b-4272-8bb4-bcc66c622265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ce1aafd8b64a1f838ebe4755233d80, user_id=29879240d90c4d05b4df714d97edd5ac, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.297132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1025/2086] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:29.297645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf52fc-212b-4272-8bb4-bcc66c622265 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.298030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.300019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:29.309850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1062/2087] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:29 2022] PUT /identity/v3/projects/b0ce1aafd8b64a1f838ebe4755233d80/users/29879240d90c4d05b4df714d97edd5ac/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:29.311619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf52fc-212b-4272-8bb4-bcc66c622265 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.325117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9220f-fbc8-43c0-a8f4-2715da56da5d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.411599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ee56f-b288-419d-80a1-81604dccc501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.412684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ee56f-b288-419d-80a1-81604dccc501 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.413246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ee56f-b288-419d-80a1-81604dccc501 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.413718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ee56f-b288-419d-80a1-81604dccc501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.425757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf52fc-212b-4272-8bb4-bcc66c622265 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.435436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c5a21-370d-4218-8378-e38ad053ff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.436322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c5a21-370d-4218-8378-e38ad053ff9f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.437361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c5a21-370d-4218-8378-e38ad053ff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.437743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c5a21-370d-4218-8378-e38ad053ff9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.438517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c5a21-370d-4218-8378-e38ad053ff9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.440573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c5a21-370d-4218-8378-e38ad053ff9f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.495414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ee56f-b288-419d-80a1-81604dccc501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.497678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ee56f-b288-419d-80a1-81604dccc501 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.515876 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1026/2088] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:29.517924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668539-f2fb-4da1-98f0-98617c7fbe60 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.518331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668539-f2fb-4da1-98f0-98617c7fbe60 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.518858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668539-f2fb-4da1-98f0-98617c7fbe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.543874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1063/2089] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:29 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:29.548082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c5a21-370d-4218-8378-e38ad053ff9f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.575005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-91668539-f2fb-4da1-98f0-98617c7fbe60 None None] MFA Rules not processed for user `29879240d90c4d05b4df714d97edd5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:29.576243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-91668539-f2fb-4da1-98f0-98617c7fbe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:29.641111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c5a21-370d-4218-8378-e38ad053ff9f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.664145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd3daa-b9f2-4518-af16-f184a2422532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.665170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd3daa-b9f2-4518-af16-f184a2422532 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.666687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd3daa-b9f2-4518-af16-f184a2422532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.672112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd3daa-b9f2-4518-af16-f184a2422532 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.672881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd3daa-b9f2-4518-af16-f184a2422532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.678688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1027/2090] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:29.679496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd3daa-b9f2-4518-af16-f184a2422532 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.771280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91668539-f2fb-4da1-98f0-98617c7fbe60 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.823537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1064/2091] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:29 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:29.824905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91668539-f2fb-4da1-98f0-98617c7fbe60 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.825154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd3daa-b9f2-4518-af16-f184a2422532 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.828682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b96d23-99fc-42ab-ab41-1077c438bec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.829326 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b96d23-99fc-42ab-ab41-1077c438bec9 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.829700 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b96d23-99fc-42ab-ab41-1077c438bec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.830193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b96d23-99fc-42ab-ab41-1077c438bec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.835199 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd3daa-b9f2-4518-af16-f184a2422532 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.839707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b96d23-99fc-42ab-ab41-1077c438bec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.839847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439b7e8-e02c-4e8c-a805-c750304cad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.840437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b7e8-e02c-4e8c-a805-c750304cad1b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.840721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b7e8-e02c-4e8c-a805-c750304cad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.840991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b7e8-e02c-4e8c-a805-c750304cad1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.841292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b96d23-99fc-42ab-ab41-1077c438bec9 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.841652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439b7e8-e02c-4e8c-a805-c750304cad1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.848623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:29.850710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439b7e8-e02c-4e8c-a805-c750304cad1b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.854520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1028/2092] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:29.862774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1065/2093] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:29.866809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b96d23-99fc-42ab-ab41-1077c438bec9 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.878377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b96d23-99fc-42ab-ab41-1077c438bec9 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.882964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48a1ca-7545-4b01-bcc4-e45a077c8327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.883563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48a1ca-7545-4b01-bcc4-e45a077c8327 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.885992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48a1ca-7545-4b01-bcc4-e45a077c8327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.885992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48a1ca-7545-4b01-bcc4-e45a077c8327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.885992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48a1ca-7545-4b01-bcc4-e45a077c8327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.886455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48a1ca-7545-4b01-bcc4-e45a077c8327 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.896423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1029/2094] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:29.900577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439b7e8-e02c-4e8c-a805-c750304cad1b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.916030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439b7e8-e02c-4e8c-a805-c750304cad1b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.920756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ef087-00cd-459f-bb78-b3fcb6ae762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.921990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef087-00cd-459f-bb78-b3fcb6ae762a admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.922298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef087-00cd-459f-bb78-b3fcb6ae762a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.922567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef087-00cd-459f-bb78-b3fcb6ae762a admin admin] PATH_INFO: `/v3/projects/4503fe37bfc94fe6a43e1f382649a1be/users/2bc023e1b53d4da38703701ebc326e4e/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.947369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ef087-00cd-459f-bb78-b3fcb6ae762a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4503fe37bfc94fe6a43e1f382649a1be, user_id=2bc023e1b53d4da38703701ebc326e4e, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:29.950625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ef087-00cd-459f-bb78-b3fcb6ae762a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:29.971220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48a1ca-7545-4b01-bcc4-e45a077c8327 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:29.981037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48a1ca-7545-4b01-bcc4-e45a077c8327 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:29.985241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:29.985841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:29.986147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:29.986424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:29.988163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:30.061440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1066/2095] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:29 2022] PUT /identity/v3/projects/4503fe37bfc94fe6a43e1f382649a1be/users/2bc023e1b53d4da38703701ebc326e4e/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:30.088867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:30.088867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:30.094553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a495bb3-2353-4eea-b20f-3b4dd9b507ac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:30.094842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a495bb3-2353-4eea-b20f-3b4dd9b507ac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:30.095126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a495bb3-2353-4eea-b20f-3b4dd9b507ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:30.105600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1030/2096] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:30.147911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:30.156174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3a495bb3-2353-4eea-b20f-3b4dd9b507ac None None] MFA Rules not processed for user `2bc023e1b53d4da38703701ebc326e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:30.157525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a495bb3-2353-4eea-b20f-3b4dd9b507ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:30.266686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1067/2097] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:30.282825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:30.284641 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:30.394036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be6e23-f380-4860-b3af-4380fc3af583 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:30.456195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb017d3a-956f-4689-b6ae-5310676d69dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8339b6461e4e28bc397dcd3f85e1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:30.456813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb017d3a-956f-4689-b6ae-5310676d69dc service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:30.457113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb017d3a-956f-4689-b6ae-5310676d69dc service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:30.457374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb017d3a-956f-4689-b6ae-5310676d69dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:30.471287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb017d3a-956f-4689-b6ae-5310676d69dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:30.471287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb017d3a-956f-4689-b6ae-5310676d69dc service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:30.486319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1031/2098] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:30.767734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a495bb3-2353-4eea-b20f-3b4dd9b507ac None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:30.815202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:30.888843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a495bb3-2353-4eea-b20f-3b4dd9b507ac None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:30.898396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:30.899200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:30.901429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:30.901742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] PATH_INFO: `/v3/users/44262a9625454163879681b45f56c5e6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:30.904685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44262a9625454163879681b45f56c5e6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:30.909879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:30.937832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:31.184366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44262a9625454163879681b45f56c5e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:31.187653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44262a9625454163879681b45f56c5e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:31.197516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44262a9625454163879681b45f56c5e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:31.266390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44262a9625454163879681b45f56c5e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:31.267320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44262a9625454163879681b45f56c5e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:31.299283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1068/2099] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:30 2022] DELETE /identity/v3/users/44262a9625454163879681b45f56c5e6 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:31.300693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e5d1-0655-4934-a6da-84fe89955fa0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:31.300986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e5d1-0655-4934-a6da-84fe89955fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:31.301322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e5d1-0655-4934-a6da-84fe89955fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:31.357662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b339e5d1-0655-4934-a6da-84fe89955fa0 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:31.359501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b339e5d1-0655-4934-a6da-84fe89955fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:31.472685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1032/2100] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:31.484195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:31.486507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:31.599331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa33631-ee74-40bc-9299-e7850b04b97f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:31.610928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f91be5-40cb-4237-a5be-5bdc2e2b518c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:31.610928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f91be5-40cb-4237-a5be-5bdc2e2b518c service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:31.610928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f91be5-40cb-4237-a5be-5bdc2e2b518c service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:31.610928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f91be5-40cb-4237-a5be-5bdc2e2b518c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:31.620795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f91be5-40cb-4237-a5be-5bdc2e2b518c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:31.622370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f91be5-40cb-4237-a5be-5bdc2e2b518c service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:31.634126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1069/2101] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:31.925687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:32.185212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e5d1-0655-4934-a6da-84fe89955fa0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:32.186155 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b339e5d1-0655-4934-a6da-84fe89955fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:32.208396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e5d1-0655-4934-a6da-84fe89955fa0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:32.213029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:32.213683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:32.213967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:32.214286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] PATH_INFO: `/v3/projects/efa91acb392b40ccbbdd624022f4ec6c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:32.215622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa91acb392b40ccbbdd624022f4ec6c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:32.219781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:32.397079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa91acb392b40ccbbdd624022f4ec6c', 'request_id': 'req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:32.406588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa91acb392b40ccbbdd624022f4ec6c', 'request_id': 'req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:32.414377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa91acb392b40ccbbdd624022f4ec6c', 'request_id': 'req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:32.421699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:32.533208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f91be5-40cb-4237-a5be-5bdc2e2b518c service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:32.536236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-69f91be5-40cb-4237-a5be-5bdc2e2b518c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:32.559489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f91be5-40cb-4237-a5be-5bdc2e2b518c service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:32.616563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] The token cache is being invalidate because project efa91acb392b40ccbbdd624022f4ec6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:32.616947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:32.621183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:32.635936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1033/2102] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:32 2022] DELETE /identity/v3/projects/efa91acb392b40ccbbdd624022f4ec6c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:32.637406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:32.640271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:32.759574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:32.766305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:32.766607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:32.766897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] PATH_INFO: `/v3/users/7d60c94216a14fd6b5fbe513fb79559d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:32.774851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d60c94216a14fd6b5fbe513fb79559d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:32.780560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:32.920245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6fb39-d565-4ae7-9f3d-80b3019d40bc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:32.941625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:32.948000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:32.957230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:32.957230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:32.957230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] PATH_INFO: `/v3/users/29879240d90c4d05b4df714d97edd5ac` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:32.957230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29879240d90c4d05b4df714d97edd5ac)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:32.957230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:33.092558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d60c94216a14fd6b5fbe513fb79559d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.094178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d60c94216a14fd6b5fbe513fb79559d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.102836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d60c94216a14fd6b5fbe513fb79559d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.186374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d60c94216a14fd6b5fbe513fb79559d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.187094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d1183f51-71e6-4f46-a4b4-b5dfd45bc0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d60c94216a14fd6b5fbe513fb79559d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.205493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29879240d90c4d05b4df714d97edd5ac'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.206304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29879240d90c4d05b4df714d97edd5ac'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.211777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1070/2103] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:32 2022] DELETE /identity/v3/users/7d60c94216a14fd6b5fbe513fb79559d => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:33.214851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29879240d90c4d05b4df714d97edd5ac'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.215614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29879240d90c4d05b4df714d97edd5ac'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.216293 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c044d-f8f3-4221-b302-c0f2ab1ddd11 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:33.216576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c044d-f8f3-4221-b302-c0f2ab1ddd11 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:33.217207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c044d-f8f3-4221-b302-c0f2ab1ddd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:33.237609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29879240d90c4d05b4df714d97edd5ac'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:33.249393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-921c044d-f8f3-4221-b302-c0f2ab1ddd11 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:33.250565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-921c044d-f8f3-4221-b302-c0f2ab1ddd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:33.322801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1071/2104] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:33.333376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c044d-f8f3-4221-b302-c0f2ab1ddd11 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:33.334952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-921c044d-f8f3-4221-b302-c0f2ab1ddd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:33.394889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1034/2105] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:32 2022] DELETE /identity/v3/users/29879240d90c4d05b4df714d97edd5ac => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:33.421714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c044d-f8f3-4221-b302-c0f2ab1ddd11 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:33.478716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:33.493281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478901c-4cf9-4096-a2d5-588a99169abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:33.494013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478901c-4cf9-4096-a2d5-588a99169abe service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:33.494439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478901c-4cf9-4096-a2d5-588a99169abe service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:33.494796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478901c-4cf9-4096-a2d5-588a99169abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:33.581628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478901c-4cf9-4096-a2d5-588a99169abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:33.583100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478901c-4cf9-4096-a2d5-588a99169abe service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:33.611358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1072/2106] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:33.758442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:34.175443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:34.178333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:34.197144 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c5e81-f6a2-4a3f-9e8d-b0afa36d8e43 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:34.204497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:34.205356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:34.205810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:34.206419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] PATH_INFO: `/v3/projects/b0ce1aafd8b64a1f838ebe4755233d80` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:34.208347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ce1aafd8b64a1f838ebe4755233d80)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:34.211043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:34.308769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478901c-4cf9-4096-a2d5-588a99169abe service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:34.310102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5478901c-4cf9-4096-a2d5-588a99169abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:34.323821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478901c-4cf9-4096-a2d5-588a99169abe service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:34.329081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:34.329551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:34.329896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:34.330208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] PATH_INFO: `/v3/projects/216d3c48ece34377a23750be97173a76` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:34.331619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216d3c48ece34377a23750be97173a76)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:34.333592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:34.384481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ce1aafd8b64a1f838ebe4755233d80', 'request_id': 'req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.390881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ce1aafd8b64a1f838ebe4755233d80', 'request_id': 'req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.397390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ce1aafd8b64a1f838ebe4755233d80', 'request_id': 'req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.509355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] The token cache is being invalidate because project b0ce1aafd8b64a1f838ebe4755233d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:34.509659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.510434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ec0cca5a-e21d-4ab3-98d0-31e5840daae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.512159 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1035/2107] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:34 2022] DELETE /identity/v3/projects/b0ce1aafd8b64a1f838ebe4755233d80 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:34.517228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441919b-5b6c-4e8f-a7ba-985725a53e1a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:34.517497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441919b-5b6c-4e8f-a7ba-985725a53e1a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:34.517848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441919b-5b6c-4e8f-a7ba-985725a53e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:34.531008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216d3c48ece34377a23750be97173a76', 'request_id': 'req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.544949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216d3c48ece34377a23750be97173a76', 'request_id': 'req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.554415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a441919b-5b6c-4e8f-a7ba-985725a53e1a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:34.558210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a441919b-5b6c-4e8f-a7ba-985725a53e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:34.625729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216d3c48ece34377a23750be97173a76', 'request_id': 'req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.645637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] The token cache is being invalidate because project 216d3c48ece34377a23750be97173a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:34.645946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.648255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b85bbe8-b6d6-4ccb-bc09-2ce59526dd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:34.654953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1073/2108] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:34 2022] DELETE /identity/v3/projects/216d3c48ece34377a23750be97173a76 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:34.661185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067ce21-7c9a-4cbb-915d-a4b16d550c73 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:34.661305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067ce21-7c9a-4cbb-915d-a4b16d550c73 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:34.661570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067ce21-7c9a-4cbb-915d-a4b16d550c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:34.704378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5067ce21-7c9a-4cbb-915d-a4b16d550c73 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:34.705684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5067ce21-7c9a-4cbb-915d-a4b16d550c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:34.763990 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1036/2109] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:34.765544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664287-f134-4ccf-9720-43a26f91b56e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:34.765838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664287-f134-4ccf-9720-43a26f91b56e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:34.766138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664287-f134-4ccf-9720-43a26f91b56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:34.832126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-22664287-f134-4ccf-9720-43a26f91b56e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:34.833368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-22664287-f134-4ccf-9720-43a26f91b56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:34.856369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1037/2110] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:34.859662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664287-f134-4ccf-9720-43a26f91b56e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:34.870075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1074/2111] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:34.882559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434df25-bda8-4301-9133-01b4d01300c0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:34.882777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664287-f134-4ccf-9720-43a26f91b56e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:34.883191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434df25-bda8-4301-9133-01b4d01300c0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:34.883642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434df25-bda8-4301-9133-01b4d01300c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:34.895924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff13b49-64e3-4667-bc52-6b78d5a30b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:34.896805 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13b49-64e3-4667-bc52-6b78d5a30b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:34.897229 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13b49-64e3-4667-bc52-6b78d5a30b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:34.897644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13b49-64e3-4667-bc52-6b78d5a30b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:34.898622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff13b49-64e3-4667-bc52-6b78d5a30b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:34.899070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff13b49-64e3-4667-bc52-6b78d5a30b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:34.900858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff13b49-64e3-4667-bc52-6b78d5a30b52 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:34.916952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1434df25-bda8-4301-9133-01b4d01300c0 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:34.918352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1434df25-bda8-4301-9133-01b4d01300c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:34.940616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1038/2112] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:34.947226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff13b49-64e3-4667-bc52-6b78d5a30b52 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:34.958877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1075/2113] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:34.963020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434df25-bda8-4301-9133-01b4d01300c0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:34.965790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff13b49-64e3-4667-bc52-6b78d5a30b52 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:34.974521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f5ce4-77f1-49fc-89c3-04354920a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:34.975208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f5ce4-77f1-49fc-89c3-04354920a45d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:34.975554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f5ce4-77f1-49fc-89c3-04354920a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:34.975834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f5ce4-77f1-49fc-89c3-04354920a45d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:34.980190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f5ce4-77f1-49fc-89c3-04354920a45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:34.980379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f5ce4-77f1-49fc-89c3-04354920a45d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:34.981895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434df25-bda8-4301-9133-01b4d01300c0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:34.988927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a646c7-0a70-4e3f-8c0c-51624f3841e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:34.989804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a646c7-0a70-4e3f-8c0c-51624f3841e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:34.990539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a646c7-0a70-4e3f-8c0c-51624f3841e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:34.990964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a646c7-0a70-4e3f-8c0c-51624f3841e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:34.992484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a646c7-0a70-4e3f-8c0c-51624f3841e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:34.992902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a646c7-0a70-4e3f-8c0c-51624f3841e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:34.996323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a646c7-0a70-4e3f-8c0c-51624f3841e0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.033058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1076/2114] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 09:02:35.035640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a646c7-0a70-4e3f-8c0c-51624f3841e0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:35.049607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a646c7-0a70-4e3f-8c0c-51624f3841e0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:35.055292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15ff47-dd4b-4508-95f6-9069dde21a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:35.056210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15ff47-dd4b-4508-95f6-9069dde21a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.056597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15ff47-dd4b-4508-95f6-9069dde21a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.056944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15ff47-dd4b-4508-95f6-9069dde21a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.057574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15ff47-dd4b-4508-95f6-9069dde21a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:35.059728 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15ff47-dd4b-4508-95f6-9069dde21a59 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.101147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1039/2115] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:34 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:35.105389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f5ce4-77f1-49fc-89c3-04354920a45d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:35.175974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1077/2116] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:35 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:35.180498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15ff47-dd4b-4508-95f6-9069dde21a59 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:35.226318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:35.258505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f5ce4-77f1-49fc-89c3-04354920a45d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:35.287827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15ff47-dd4b-4508-95f6-9069dde21a59 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:35.293488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894601-7907-4fe4-937d-61711032f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:35.294131 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894601-7907-4fe4-937d-61711032f038 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.294410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894601-7907-4fe4-937d-61711032f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.294685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894601-7907-4fe4-937d-61711032f038 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.295333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a894601-7907-4fe4-937d-61711032f038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:35.298190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a894601-7907-4fe4-937d-61711032f038 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.376938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06a2f1-4f11-454e-8fdc-038422b82b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:35.377574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06a2f1-4f11-454e-8fdc-038422b82b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.377856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06a2f1-4f11-454e-8fdc-038422b82b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.378176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06a2f1-4f11-454e-8fdc-038422b82b22 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.379114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06a2f1-4f11-454e-8fdc-038422b82b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:35.381801 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06a2f1-4f11-454e-8fdc-038422b82b22 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.475721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1078/2117] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:35 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:35.484224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894601-7907-4fe4-937d-61711032f038 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:35.506978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894601-7907-4fe4-937d-61711032f038 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:35.513487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:35.520506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1040/2118] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:35 2022] POST /identity/v3/users => generated 287 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:35.525766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06a2f1-4f11-454e-8fdc-038422b82b22 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:35.551602 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06a2f1-4f11-454e-8fdc-038422b82b22 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:35.552582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa137af-df4b-45e2-8ad5-eb9feb13d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:35.553523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa137af-df4b-45e2-8ad5-eb9feb13d92c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.554025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa137af-df4b-45e2-8ad5-eb9feb13d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.554792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa137af-df4b-45e2-8ad5-eb9feb13d92c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.555692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa137af-df4b-45e2-8ad5-eb9feb13d92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:35.558490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa137af-df4b-45e2-8ad5-eb9feb13d92c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.564881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077b52-1dfb-4e71-b8f8-a815e8b94d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:35.565511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077b52-1dfb-4e71-b8f8-a815e8b94d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.565790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077b52-1dfb-4e71-b8f8-a815e8b94d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.566062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f077b52-1dfb-4e71-b8f8-a815e8b94d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.566812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f077b52-1dfb-4e71-b8f8-a815e8b94d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:35.571927 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f077b52-1dfb-4e71-b8f8-a815e8b94d85 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.583600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1079/2119] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:35.587531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa137af-df4b-45e2-8ad5-eb9feb13d92c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:35.607754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa137af-df4b-45e2-8ad5-eb9feb13d92c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:35.609386 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1041/2120] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:35.610702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077b52-1dfb-4e71-b8f8-a815e8b94d85 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:35.627916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc44be-a533-4dac-8647-1c19ba1a1a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:35.630158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc44be-a533-4dac-8647-1c19ba1a1a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.630503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc44be-a533-4dac-8647-1c19ba1a1a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.630810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc44be-a533-4dac-8647-1c19ba1a1a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.631486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc44be-a533-4dac-8647-1c19ba1a1a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:35.634742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f077b52-1dfb-4e71-b8f8-a815e8b94d85 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:35.636627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc44be-a533-4dac-8647-1c19ba1a1a1b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.643075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b484b58-b43f-4e77-a5ff-080715050acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:35.644069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484b58-b43f-4e77-a5ff-080715050acc admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.645082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484b58-b43f-4e77-a5ff-080715050acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.645562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b484b58-b43f-4e77-a5ff-080715050acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.646482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b484b58-b43f-4e77-a5ff-080715050acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:35.661354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b484b58-b43f-4e77-a5ff-080715050acc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.677595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1080/2121] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:35.684293 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc44be-a533-4dac-8647-1c19ba1a1a1b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:35.689360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1042/2122] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:35.691698 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b484b58-b43f-4e77-a5ff-080715050acc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:35.711063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b484b58-b43f-4e77-a5ff-080715050acc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:35.721250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc44be-a533-4dac-8647-1c19ba1a1a1b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:35.730696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef1b0b-886f-4407-b6d7-2eb23406e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:35.731554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1b0b-886f-4407-b6d7-2eb23406e1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.731894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1b0b-886f-4407-b6d7-2eb23406e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.732604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1b0b-886f-4407-b6d7-2eb23406e1c4 admin admin] PATH_INFO: `/v3/projects/b75424d52aa04a749c7a24a6fb787aa8/users/0bf6ee15b6394f34a77fa769b8354bd9/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.740885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e075322-2fd1-4001-a351-326af913c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:35.741611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075322-2fd1-4001-a351-326af913c613 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.741905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075322-2fd1-4001-a351-326af913c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.742393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075322-2fd1-4001-a351-326af913c613 admin admin] PATH_INFO: `/v3/projects/5b31e2069a06417a83615c4c3565b186/users/2003f3fec37d4320bb511e33212de018/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.760613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef1b0b-886f-4407-b6d7-2eb23406e1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75424d52aa04a749c7a24a6fb787aa8, user_id=0bf6ee15b6394f34a77fa769b8354bd9, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:35.764296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef1b0b-886f-4407-b6d7-2eb23406e1c4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.776462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e075322-2fd1-4001-a351-326af913c613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b31e2069a06417a83615c4c3565b186, user_id=2003f3fec37d4320bb511e33212de018, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:35.781708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e075322-2fd1-4001-a351-326af913c613 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:35.864383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1081/2123] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:35 2022] PUT /identity/v3/projects/b75424d52aa04a749c7a24a6fb787aa8/users/0bf6ee15b6394f34a77fa769b8354bd9/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:35.868076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a071e2-6662-47dc-a21f-c564e214a37a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.868497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a071e2-6662-47dc-a21f-c564e214a37a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.868896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a071e2-6662-47dc-a21f-c564e214a37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.893790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1043/2124] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:35 2022] PUT /identity/v3/projects/5b31e2069a06417a83615c4c3565b186/users/2003f3fec37d4320bb511e33212de018/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:35.895147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df75d0-a784-4170-9ab1-819aee69ae99 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:35.895593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df75d0-a784-4170-9ab1-819aee69ae99 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:35.896015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df75d0-a784-4170-9ab1-819aee69ae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:35.914833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-88a071e2-6662-47dc-a21f-c564e214a37a None None] MFA Rules not processed for user `a7120d37c24a48518e9b04c1c119eba5`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:35.916565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-88a071e2-6662-47dc-a21f-c564e214a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:35.953382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-75df75d0-a784-4170-9ab1-819aee69ae99 None None] MFA Rules not processed for user `0bf6ee15b6394f34a77fa769b8354bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:35.956009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-75df75d0-a784-4170-9ab1-819aee69ae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:36.042106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1082/2125] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:36.043400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28533a-e6a6-4347-bed3-ffd986f3628c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:36.044911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28533a-e6a6-4347-bed3-ffd986f3628c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:36.045581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28533a-e6a6-4347-bed3-ffd986f3628c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:36.069367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4a28533a-e6a6-4347-bed3-ffd986f3628c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:36.071195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4a28533a-e6a6-4347-bed3-ffd986f3628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:36.072321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1044/2126] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:36.078055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df75d0-a784-4170-9ab1-819aee69ae99 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:36.078055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-75df75d0-a784-4170-9ab1-819aee69ae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:36.161104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1083/2127] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:36.163212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28533a-e6a6-4347-bed3-ffd986f3628c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:36.167528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4a28533a-e6a6-4347-bed3-ffd986f3628c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:36.191042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df75d0-a784-4170-9ab1-819aee69ae99 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:36.203735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3341ed-743f-45d8-b15e-df629df79cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:36.203959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3341ed-743f-45d8-b15e-df629df79cd5 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:36.204199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3341ed-743f-45d8-b15e-df629df79cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:36.204477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3341ed-743f-45d8-b15e-df629df79cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:36.217873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3341ed-743f-45d8-b15e-df629df79cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:36.219588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3341ed-743f-45d8-b15e-df629df79cd5 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:36.230851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28533a-e6a6-4347-bed3-ffd986f3628c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:36.231333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1045/2128] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:36.232192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3341ed-743f-45d8-b15e-df629df79cd5 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:36.233552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b3341ed-743f-45d8-b15e-df629df79cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:36.234999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d403c-48da-4641-a21f-938c42ebcfbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:36.235610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d403c-48da-4641-a21f-938c42ebcfbd service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:36.235889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d403c-48da-4641-a21f-938c42ebcfbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:36.236162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d403c-48da-4641-a21f-938c42ebcfbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:36.249539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d403c-48da-4641-a21f-938c42ebcfbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:36.250328 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d403c-48da-4641-a21f-938c42ebcfbd service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:36.267919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1084/2129] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:36.317405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3341ed-743f-45d8-b15e-df629df79cd5 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:36.323159 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cf2c8-275c-4d9b-a575-dd7f366e5b34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:36.323957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cf2c8-275c-4d9b-a575-dd7f366e5b34 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:36.324309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cf2c8-275c-4d9b-a575-dd7f366e5b34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:36.324870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cf2c8-275c-4d9b-a575-dd7f366e5b34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:36.344600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cf2c8-275c-4d9b-a575-dd7f366e5b34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:36.353416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cf2c8-275c-4d9b-a575-dd7f366e5b34 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:36.375211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1046/2130] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:37.249570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:38.151938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:38.378208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a6c8-0f35-44db-b6e6-93c989a79346 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:38.379083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a6c8-0f35-44db-b6e6-93c989a79346 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:38.379680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950a6c8-0f35-44db-b6e6-93c989a79346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:38.437525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a950a6c8-0f35-44db-b6e6-93c989a79346 None None] MFA Rules not processed for user `2003f3fec37d4320bb511e33212de018`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:38.439283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a950a6c8-0f35-44db-b6e6-93c989a79346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:38.539036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1085/2131] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:38.625438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cf2c8-275c-4d9b-a575-dd7f366e5b34 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:38.627822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9a7cf2c8-275c-4d9b-a575-dd7f366e5b34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:38.645865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cf2c8-275c-4d9b-a575-dd7f366e5b34 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:38.651925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28941713-9121-4f14-b3e6-23e4f9d718e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:38.652969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28941713-9121-4f14-b3e6-23e4f9d718e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:38.654019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28941713-9121-4f14-b3e6-23e4f9d718e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:38.654563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28941713-9121-4f14-b3e6-23e4f9d718e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:38.671687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28941713-9121-4f14-b3e6-23e4f9d718e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:38.673827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28941713-9121-4f14-b3e6-23e4f9d718e0 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:38.685143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1047/2132] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:39.251047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553542-40d2-4a90-927b-7070f5620af5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:39.251333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553542-40d2-4a90-927b-7070f5620af5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:39.251610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553542-40d2-4a90-927b-7070f5620af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:39.285809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d1553542-40d2-4a90-927b-7070f5620af5 None None] MFA Rules not processed for user `a7120d37c24a48518e9b04c1c119eba5`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:39.287594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d1553542-40d2-4a90-927b-7070f5620af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:39.296494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1086/2133] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:39.379094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:39.858760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28941713-9121-4f14-b3e6-23e4f9d718e0 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:39.860416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-28941713-9121-4f14-b3e6-23e4f9d718e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:39.890625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28941713-9121-4f14-b3e6-23e4f9d718e0 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:39.893275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:39.894058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:39.894490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:39.894879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] PATH_INFO: `/v3/users/de92c789da16429892e1c2031931e242` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:39.896266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de92c789da16429892e1c2031931e242)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:39.898591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:40.173574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de92c789da16429892e1c2031931e242'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:40.175025 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de92c789da16429892e1c2031931e242'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:40.188638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de92c789da16429892e1c2031931e242'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:40.190389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de92c789da16429892e1c2031931e242'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:40.201886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:40.213221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de92c789da16429892e1c2031931e242'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:40.310030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1048/2134] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:39 2022] DELETE /identity/v3/users/de92c789da16429892e1c2031931e242 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:40.316119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59efc9d-73f4-4d93-aef6-d422e820b68c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:40.316408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59efc9d-73f4-4d93-aef6-d422e820b68c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:40.316689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59efc9d-73f4-4d93-aef6-d422e820b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:40.344232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b59efc9d-73f4-4d93-aef6-d422e820b68c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:40.345497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b59efc9d-73f4-4d93-aef6-d422e820b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:40.441531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1087/2135] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:40.456754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:40.457753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:40.577007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f849923-612f-48fb-9957-4ba1311ef8d7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:40.583899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b246f-5889-4606-9f75-593b2351ffc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:40.584755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b246f-5889-4606-9f75-593b2351ffc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:40.585359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b246f-5889-4606-9f75-593b2351ffc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:40.585769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b246f-5889-4606-9f75-593b2351ffc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:40.598614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b246f-5889-4606-9f75-593b2351ffc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:40.601097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b246f-5889-4606-9f75-593b2351ffc4 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:40.613711 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1049/2136] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:40.776853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32c698-4ed5-46c2-ba40-3c55070c0857 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:40.777143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32c698-4ed5-46c2-ba40-3c55070c0857 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:40.780721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32c698-4ed5-46c2-ba40-3c55070c0857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:40.807571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7c32c698-4ed5-46c2-ba40-3c55070c0857 None None] MFA Rules not processed for user `2003f3fec37d4320bb511e33212de018`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:40.808932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7c32c698-4ed5-46c2-ba40-3c55070c0857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:40.939757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1088/2137] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:41.194523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b246f-5889-4606-9f75-593b2351ffc4 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:41.196056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9b4b246f-5889-4606-9f75-593b2351ffc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:41.213925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b246f-5889-4606-9f75-593b2351ffc4 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:41.220351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:41.221365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:41.222030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:41.222440 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] PATH_INFO: `/v3/projects/48a534fe86b7440ea806522752cd0de0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:41.224866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a534fe86b7440ea806522752cd0de0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:41.227661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:41.376028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a534fe86b7440ea806522752cd0de0', 'request_id': 'req-c003db4e-67e6-433a-89aa-cd58b4dcce98'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.383480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a534fe86b7440ea806522752cd0de0', 'request_id': 'req-c003db4e-67e6-433a-89aa-cd58b4dcce98'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.391115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a534fe86b7440ea806522752cd0de0', 'request_id': 'req-c003db4e-67e6-433a-89aa-cd58b4dcce98'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.489352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] The token cache is being invalidate because project 48a534fe86b7440ea806522752cd0de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:41.489650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.495906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.495906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1050/2138] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:41 2022] DELETE /identity/v3/projects/48a534fe86b7440ea806522752cd0de0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:41.497465 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32c698-4ed5-46c2-ba40-3c55070c0857 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:41.517761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32c698-4ed5-46c2-ba40-3c55070c0857 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:41.565823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:41.605287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:41.605885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:41.606203 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:41.606489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] PATH_INFO: `/v3/users/c972f88ff26c448c9988be9976a16c7d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:41.607657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c972f88ff26c448c9988be9976a16c7d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:41.610165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:41.816308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c972f88ff26c448c9988be9976a16c7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.816998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c972f88ff26c448c9988be9976a16c7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.824185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c972f88ff26c448c9988be9976a16c7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.945661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c972f88ff26c448c9988be9976a16c7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.946415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2e9cffdc-1efb-4e94-86fc-a3a1cbc62d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c972f88ff26c448c9988be9976a16c7d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:41.965953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1089/2139] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:41 2022] DELETE /identity/v3/users/c972f88ff26c448c9988be9976a16c7d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:41.975759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:42.484554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:42.485956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:42.486470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:42.508473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003db4e-67e6-433a-89aa-cd58b4dcce98 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:42.588000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:42.588755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:42.589041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:42.589317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] PATH_INFO: `/v3/projects/5b779f650f7041d2aa37b01f10c69118` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:42.603741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b779f650f7041d2aa37b01f10c69118)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:42.606317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:42.798824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b779f650f7041d2aa37b01f10c69118', 'request_id': 'req-30807354-2276-4f9f-a5ea-1d3865512928'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:42.807328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b779f650f7041d2aa37b01f10c69118', 'request_id': 'req-30807354-2276-4f9f-a5ea-1d3865512928'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:42.817529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b779f650f7041d2aa37b01f10c69118', 'request_id': 'req-30807354-2276-4f9f-a5ea-1d3865512928'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:42.894661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] The token cache is being invalidate because project 5b779f650f7041d2aa37b01f10c69118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:42.895074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:42.895714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30807354-2276-4f9f-a5ea-1d3865512928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:42.897222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1051/2140] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:42 2022] DELETE /identity/v3/projects/5b779f650f7041d2aa37b01f10c69118 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:42.903497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebe038-b859-4a16-a9a3-88eeaf48b463 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:42.904013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebe038-b859-4a16-a9a3-88eeaf48b463 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:42.904108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebe038-b859-4a16-a9a3-88eeaf48b463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:42.923684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-82ebe038-b859-4a16-a9a3-88eeaf48b463 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:42.924924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-82ebe038-b859-4a16-a9a3-88eeaf48b463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:42.988665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1090/2141] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:42.996738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01738a-8d4f-4991-ac97-ed04efdd15a7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:42.997032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01738a-8d4f-4991-ac97-ed04efdd15a7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:42.997310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01738a-8d4f-4991-ac97-ed04efdd15a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:43.029984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2b01738a-8d4f-4991-ac97-ed04efdd15a7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:43.031256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2b01738a-8d4f-4991-ac97-ed04efdd15a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:43.040231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1052/2142] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:43.044674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebe038-b859-4a16-a9a3-88eeaf48b463 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:43.056256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebe038-b859-4a16-a9a3-88eeaf48b463 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:43.062057 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541960e2-0b45-432a-b61a-fe5037118e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:43.062917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541960e2-0b45-432a-b61a-fe5037118e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:43.063199 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541960e2-0b45-432a-b61a-fe5037118e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:43.063467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541960e2-0b45-432a-b61a-fe5037118e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:43.064143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541960e2-0b45-432a-b61a-fe5037118e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:43.064447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541960e2-0b45-432a-b61a-fe5037118e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:43.066321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541960e2-0b45-432a-b61a-fe5037118e4a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:43.082766 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1091/2143] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:43.087452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01738a-8d4f-4991-ac97-ed04efdd15a7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:43.098020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01738a-8d4f-4991-ac97-ed04efdd15a7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:43.104022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a35cf-f855-4628-a29f-003d5310e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:43.104672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a35cf-f855-4628-a29f-003d5310e621 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:43.104955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a35cf-f855-4628-a29f-003d5310e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:43.105231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a35cf-f855-4628-a29f-003d5310e621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:43.105905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a35cf-f855-4628-a29f-003d5310e621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:43.109754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a35cf-f855-4628-a29f-003d5310e621 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:43.207496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1053/2144] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:43 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:43.208490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541960e2-0b45-432a-b61a-fe5037118e4a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:43.218540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541960e2-0b45-432a-b61a-fe5037118e4a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:43.283682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab55009-a2c3-4af1-9401-1dc992242f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:43.284297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab55009-a2c3-4af1-9401-1dc992242f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:43.284584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab55009-a2c3-4af1-9401-1dc992242f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:43.284866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab55009-a2c3-4af1-9401-1dc992242f4a admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:43.285516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab55009-a2c3-4af1-9401-1dc992242f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:43.287535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab55009-a2c3-4af1-9401-1dc992242f4a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:43.403027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1092/2145] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:43 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:43.407152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a35cf-f855-4628-a29f-003d5310e621 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:43.417425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a35cf-f855-4628-a29f-003d5310e621 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:43.422651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2200ed-487b-4b11-ae80-915db20f0449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:43.423250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2200ed-487b-4b11-ae80-915db20f0449 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:43.423557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2200ed-487b-4b11-ae80-915db20f0449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:43.423800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2200ed-487b-4b11-ae80-915db20f0449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:43.424471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2200ed-487b-4b11-ae80-915db20f0449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:43.426063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2200ed-487b-4b11-ae80-915db20f0449 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:43.439103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1054/2146] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:43.443734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab55009-a2c3-4af1-9401-1dc992242f4a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:43.454511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab55009-a2c3-4af1-9401-1dc992242f4a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:43.464312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a5cab-25ba-4f21-a14a-8ecc9239a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:43.464939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a5cab-25ba-4f21-a14a-8ecc9239a2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:43.465225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a5cab-25ba-4f21-a14a-8ecc9239a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:43.465500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a5cab-25ba-4f21-a14a-8ecc9239a2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:43.466196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a5cab-25ba-4f21-a14a-8ecc9239a2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:43.468353 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a5cab-25ba-4f21-a14a-8ecc9239a2f1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:43.479502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1093/2147] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:43.484366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2200ed-487b-4b11-ae80-915db20f0449 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:43.499253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2200ed-487b-4b11-ae80-915db20f0449 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:43.504353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe96b5d-1c59-411c-8dd0-decfa842ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:43.505347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe96b5d-1c59-411c-8dd0-decfa842ba03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:43.505635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe96b5d-1c59-411c-8dd0-decfa842ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:43.505910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe96b5d-1c59-411c-8dd0-decfa842ba03 admin admin] PATH_INFO: `/v3/projects/7aee0ffbde364d69971109059ec992f0/users/b4f101da43c644f7a7583cc7a4bd7f1b/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:43.521844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe96b5d-1c59-411c-8dd0-decfa842ba03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aee0ffbde364d69971109059ec992f0, user_id=b4f101da43c644f7a7583cc7a4bd7f1b, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:43.524648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe96b5d-1c59-411c-8dd0-decfa842ba03 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:43.609402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1055/2148] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:43 2022] PUT /identity/v3/projects/7aee0ffbde364d69971109059ec992f0/users/b4f101da43c644f7a7583cc7a4bd7f1b/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:43.620267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdddf1-249a-4cc3-b9fc-09e807f7c671 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:43.620553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdddf1-249a-4cc3-b9fc-09e807f7c671 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:43.620827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdddf1-249a-4cc3-b9fc-09e807f7c671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:43.649023 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b0cdddf1-249a-4cc3-b9fc-09e807f7c671 None None] MFA Rules not processed for user `b4f101da43c644f7a7583cc7a4bd7f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:43.650259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b0cdddf1-249a-4cc3-b9fc-09e807f7c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:43.723933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1094/2149] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:43.728432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe96b5d-1c59-411c-8dd0-decfa842ba03 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:43.790902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe96b5d-1c59-411c-8dd0-decfa842ba03 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:43.796271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace4bde-8efe-4812-ac5a-45e3b9de24a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:43.796879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace4bde-8efe-4812-ac5a-45e3b9de24a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:43.797163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace4bde-8efe-4812-ac5a-45e3b9de24a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:43.797438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace4bde-8efe-4812-ac5a-45e3b9de24a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:43.798103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace4bde-8efe-4812-ac5a-45e3b9de24a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:43.800172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace4bde-8efe-4812-ac5a-45e3b9de24a0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:43.892458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1056/2150] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:43 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:43.896729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdddf1-249a-4cc3-b9fc-09e807f7c671 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:43.938486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdddf1-249a-4cc3-b9fc-09e807f7c671 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:44.070244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7a50-3da3-4a83-a567-40240ec1a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:44.070244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7a50-3da3-4a83-a567-40240ec1a2ba admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:44.070447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7a50-3da3-4a83-a567-40240ec1a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:44.070769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7a50-3da3-4a83-a567-40240ec1a2ba admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:44.071214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c7a50-3da3-4a83-a567-40240ec1a2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:44.073174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c7a50-3da3-4a83-a567-40240ec1a2ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:44.163052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1095/2151] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:43 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:44.167036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace4bde-8efe-4812-ac5a-45e3b9de24a0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:44.177555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace4bde-8efe-4812-ac5a-45e3b9de24a0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:44.182485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352bdd3-461b-48a9-870a-04fdad350edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:44.183083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352bdd3-461b-48a9-870a-04fdad350edc admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:44.183364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352bdd3-461b-48a9-870a-04fdad350edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:44.183639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352bdd3-461b-48a9-870a-04fdad350edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:44.184285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352bdd3-461b-48a9-870a-04fdad350edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:44.185906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352bdd3-461b-48a9-870a-04fdad350edc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:44.197210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1057/2152] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:44.201905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7a50-3da3-4a83-a567-40240ec1a2ba admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:44.213769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7a50-3da3-4a83-a567-40240ec1a2ba admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:44.219310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed95af-6c38-4216-9412-db550f170f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:44.220007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed95af-6c38-4216-9412-db550f170f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:44.220702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed95af-6c38-4216-9412-db550f170f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:44.220702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed95af-6c38-4216-9412-db550f170f28 admin admin] PATH_INFO: `/v3/projects/bb092497d58e49c98f02f9964b88bd6b/users/def61b1c43f04bc28560924af29778c5/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:44.235798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed95af-6c38-4216-9412-db550f170f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb092497d58e49c98f02f9964b88bd6b, user_id=def61b1c43f04bc28560924af29778c5, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:44.238615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed95af-6c38-4216-9412-db550f170f28 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:44.300592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:44.368372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1096/2153] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:44 2022] PUT /identity/v3/projects/bb092497d58e49c98f02f9964b88bd6b/users/def61b1c43f04bc28560924af29778c5/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:44.372311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352bdd3-461b-48a9-870a-04fdad350edc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:44.383073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352bdd3-461b-48a9-870a-04fdad350edc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:44.445042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b3550-1a7b-478e-a0ad-a73137681482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:44.445651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b3550-1a7b-478e-a0ad-a73137681482 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:44.445933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b3550-1a7b-478e-a0ad-a73137681482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:44.446248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b3550-1a7b-478e-a0ad-a73137681482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:44.446893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b3550-1a7b-478e-a0ad-a73137681482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:44.448490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b3550-1a7b-478e-a0ad-a73137681482 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:44.458559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1058/2154] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:44.462852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed95af-6c38-4216-9412-db550f170f28 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:44.473640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed95af-6c38-4216-9412-db550f170f28 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:44.478433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec0493-21f7-409b-8701-50f4305bc49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:44.479082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0493-21f7-409b-8701-50f4305bc49d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:44.479373 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0493-21f7-409b-8701-50f4305bc49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:44.479641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec0493-21f7-409b-8701-50f4305bc49d admin admin] PATH_INFO: `/v3/projects/bb092497d58e49c98f02f9964b88bd6b/users/def61b1c43f04bc28560924af29778c5/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:44.481541 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec0493-21f7-409b-8701-50f4305bc49d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb092497d58e49c98f02f9964b88bd6b, user_id=def61b1c43f04bc28560924af29778c5, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:44.484222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec0493-21f7-409b-8701-50f4305bc49d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:44.494599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1097/2155] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:44 2022] PUT /identity/v3/projects/bb092497d58e49c98f02f9964b88bd6b/users/def61b1c43f04bc28560924af29778c5/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:44.506498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9e1f3-a9eb-4450-ab24-a70b4acc1af6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:44.506969 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9e1f3-a9eb-4450-ab24-a70b4acc1af6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:44.507085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9e1f3-a9eb-4450-ab24-a70b4acc1af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:44.536696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-24f9e1f3-a9eb-4450-ab24-a70b4acc1af6 None None] MFA Rules not processed for user `def61b1c43f04bc28560924af29778c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:44.538665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-24f9e1f3-a9eb-4450-ab24-a70b4acc1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:44.647963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1059/2156] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:44.660058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec0493-21f7-409b-8701-50f4305bc49d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:44.661928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6dec0493-21f7-409b-8701-50f4305bc49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:44.727489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec0493-21f7-409b-8701-50f4305bc49d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:44.732599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210501-a5ea-4039-86c6-cf085dc9fbe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:44.733735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210501-a5ea-4039-86c6-cf085dc9fbe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:44.734019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210501-a5ea-4039-86c6-cf085dc9fbe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:44.734365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75210501-a5ea-4039-86c6-cf085dc9fbe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:44.746861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75210501-a5ea-4039-86c6-cf085dc9fbe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:44.749157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75210501-a5ea-4039-86c6-cf085dc9fbe1 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:44.762108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1098/2157] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:44.883683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:44.908145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9e1f3-a9eb-4450-ab24-a70b4acc1af6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:44.909855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-24f9e1f3-a9eb-4450-ab24-a70b4acc1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:44.923299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9e1f3-a9eb-4450-ab24-a70b4acc1af6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:44.942443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cdcd2-e754-45a4-960d-52c112040244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:44.944184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cdcd2-e754-45a4-960d-52c112040244 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:44.944724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cdcd2-e754-45a4-960d-52c112040244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:44.949097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cdcd2-e754-45a4-960d-52c112040244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:45.041869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cdcd2-e754-45a4-960d-52c112040244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:45.043369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cdcd2-e754-45a4-960d-52c112040244 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:45.066297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1060/2158] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:46.506527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:46.740364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:47.506701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:49.571789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:51.021833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210501-a5ea-4039-86c6-cf085dc9fbe1 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:51.023459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-75210501-a5ea-4039-86c6-cf085dc9fbe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:51.092645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75210501-a5ea-4039-86c6-cf085dc9fbe1 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:51.097291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:51.097920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:51.098262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:51.098545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] PATH_INFO: `/v3/users/2bc023e1b53d4da38703701ebc326e4e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:51.100503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc023e1b53d4da38703701ebc326e4e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:51.102825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:51.103863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cdcd2-e754-45a4-960d-52c112040244 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:51.117518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cdcd2-e754-45a4-960d-52c112040244 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:51.122632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:51.123267 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:51.123556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:51.123836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] PATH_INFO: `/v3/users/b4f101da43c644f7a7583cc7a4bd7f1b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:51.125020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f101da43c644f7a7583cc7a4bd7f1b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:51.127038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:51.331464 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc023e1b53d4da38703701ebc326e4e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.332382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc023e1b53d4da38703701ebc326e4e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.340672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc023e1b53d4da38703701ebc326e4e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.371277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f101da43c644f7a7583cc7a4bd7f1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.372234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f101da43c644f7a7583cc7a4bd7f1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.380503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f101da43c644f7a7583cc7a4bd7f1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.381562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f101da43c644f7a7583cc7a4bd7f1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.405878 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63d31e17-783c-4c37-aa96-f21f7959fdec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f101da43c644f7a7583cc7a4bd7f1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.442131 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc023e1b53d4da38703701ebc326e4e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.442699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f59c469c-3867-4543-a1fd-bd5d44c00ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc023e1b53d4da38703701ebc326e4e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:51.460151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:51.473462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1099/2159] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:51 2022] DELETE /identity/v3/users/2bc023e1b53d4da38703701ebc326e4e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:51.477949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d78017-d2c1-4342-bb73-f698705064c7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:51.478272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d78017-d2c1-4342-bb73-f698705064c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:51.479216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d78017-d2c1-4342-bb73-f698705064c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:51.500107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-71d78017-d2c1-4342-bb73-f698705064c7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:51.501375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-71d78017-d2c1-4342-bb73-f698705064c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:51.553461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1061/2160] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:51 2022] DELETE /identity/v3/users/b4f101da43c644f7a7583cc7a4bd7f1b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:51.559611 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affb1cf-9ab9-47cf-91c8-df4a7bfc5d9c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:51.560110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affb1cf-9ab9-47cf-91c8-df4a7bfc5d9c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:51.560930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affb1cf-9ab9-47cf-91c8-df4a7bfc5d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:51.583628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1100/2161] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:51.592543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d78017-d2c1-4342-bb73-f698705064c7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:51.594704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-71d78017-d2c1-4342-bb73-f698705064c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:51.595600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3affb1cf-9ab9-47cf-91c8-df4a7bfc5d9c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:51.596887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3affb1cf-9ab9-47cf-91c8-df4a7bfc5d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:51.643947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:51.673337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1062/2162] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:51.683561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affb1cf-9ab9-47cf-91c8-df4a7bfc5d9c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:51.685116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3affb1cf-9ab9-47cf-91c8-df4a7bfc5d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:51.749921 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affb1cf-9ab9-47cf-91c8-df4a7bfc5d9c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:51.754255 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11428e-6676-4736-b849-dc2bf6e8f19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:51.754907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11428e-6676-4736-b849-dc2bf6e8f19e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:51.755198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11428e-6676-4736-b849-dc2bf6e8f19e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:51.755473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11428e-6676-4736-b849-dc2bf6e8f19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:51.765957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11428e-6676-4736-b849-dc2bf6e8f19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:51.767707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11428e-6676-4736-b849-dc2bf6e8f19e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:51.778903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1063/2163] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:51.800282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d78017-d2c1-4342-bb73-f698705064c7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:51.807589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9bfad-8c01-4023-8203-8fb261ca5074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:51.808525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9bfad-8c01-4023-8203-8fb261ca5074 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:51.808807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9bfad-8c01-4023-8203-8fb261ca5074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:51.809129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9bfad-8c01-4023-8203-8fb261ca5074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:51.820278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9bfad-8c01-4023-8203-8fb261ca5074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:51.821822 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9bfad-8c01-4023-8203-8fb261ca5074 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:51.835897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1101/2164] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:52.468082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11428e-6676-4736-b849-dc2bf6e8f19e service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:52.469770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4c11428e-6676-4736-b849-dc2bf6e8f19e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:52.488008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11428e-6676-4736-b849-dc2bf6e8f19e service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:52.496118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:52.497816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9bfad-8c01-4023-8203-8fb261ca5074 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:52.499852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ced9bfad-8c01-4023-8203-8fb261ca5074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:52.501266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:52.502754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:52.513721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] PATH_INFO: `/v3/projects/7aee0ffbde364d69971109059ec992f0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:52.516706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aee0ffbde364d69971109059ec992f0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:52.519221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:52.521296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9bfad-8c01-4023-8203-8fb261ca5074 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:52.552105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:52.552105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:52.552105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:52.552105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] PATH_INFO: `/v3/projects/4503fe37bfc94fe6a43e1f382649a1be` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:52.553162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4503fe37bfc94fe6a43e1f382649a1be)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:52.560303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:52.693005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aee0ffbde364d69971109059ec992f0', 'request_id': 'req-075f359e-3ad3-4afb-80ab-b8e5586360ac'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.701860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aee0ffbde364d69971109059ec992f0', 'request_id': 'req-075f359e-3ad3-4afb-80ab-b8e5586360ac'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.703030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4503fe37bfc94fe6a43e1f382649a1be', 'request_id': 'req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.708931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aee0ffbde364d69971109059ec992f0', 'request_id': 'req-075f359e-3ad3-4afb-80ab-b8e5586360ac'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.710377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4503fe37bfc94fe6a43e1f382649a1be', 'request_id': 'req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.792648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] The token cache is being invalidate because project 7aee0ffbde364d69971109059ec992f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:52.795423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.795423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.797262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1064/2165] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:52 2022] DELETE /identity/v3/projects/7aee0ffbde364d69971109059ec992f0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:52.801653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:52.803528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:52.854306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4503fe37bfc94fe6a43e1f382649a1be', 'request_id': 'req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.873670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] The token cache is being invalidate because project 4503fe37bfc94fe6a43e1f382649a1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:52.874127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.876972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6eaf8ab-9f3c-43e5-91af-02abebce3ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:52.881763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1102/2166] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:52 2022] DELETE /identity/v3/projects/4503fe37bfc94fe6a43e1f382649a1be => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:52.889713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f359e-3ad3-4afb-80ab-b8e5586360ac admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:52.891433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8d520-55b9-47c1-8df9-3cc1c5b4c51c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:52.891828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8d520-55b9-47c1-8df9-3cc1c5b4c51c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:52.892106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8d520-55b9-47c1-8df9-3cc1c5b4c51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:52.913141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-49c8d520-55b9-47c1-8df9-3cc1c5b4c51c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:52.914403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49c8d520-55b9-47c1-8df9-3cc1c5b4c51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:52.953058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:52.953704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:52.953984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:52.954288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] PATH_INFO: `/v3/users/def61b1c43f04bc28560924af29778c5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:52.955473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] RBAC: Authorizing `identity:delete_user(user_id=def61b1c43f04bc28560924af29778c5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:52.957470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:52.978877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1103/2167] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:52.987671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b02c9-d825-471c-a6a1-22fff8ce91df None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:52.987978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b02c9-d825-471c-a6a1-22fff8ce91df None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:52.988230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b02c9-d825-471c-a6a1-22fff8ce91df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:53.007038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5d3b02c9-d825-471c-a6a1-22fff8ce91df None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:53.008222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5d3b02c9-d825-471c-a6a1-22fff8ce91df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:53.016545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1104/2168] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:53.020539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b02c9-d825-471c-a6a1-22fff8ce91df None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:53.033400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b02c9-d825-471c-a6a1-22fff8ce91df None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:53.035115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356526b5-de6b-4f3a-80fe-16a4b44bc61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:53.035681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356526b5-de6b-4f3a-80fe-16a4b44bc61b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:53.035956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356526b5-de6b-4f3a-80fe-16a4b44bc61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:53.036223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356526b5-de6b-4f3a-80fe-16a4b44bc61b admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:53.036853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356526b5-de6b-4f3a-80fe-16a4b44bc61b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:53.037151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356526b5-de6b-4f3a-80fe-16a4b44bc61b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:53.038758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356526b5-de6b-4f3a-80fe-16a4b44bc61b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:53.050006 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1105/2169] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 09:02:53.054300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356526b5-de6b-4f3a-80fe-16a4b44bc61b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:53.063909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356526b5-de6b-4f3a-80fe-16a4b44bc61b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:53.068324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a73c5e-7799-44ef-8da7-4fde7af777b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:53.068929 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a73c5e-7799-44ef-8da7-4fde7af777b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:53.069205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a73c5e-7799-44ef-8da7-4fde7af777b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:53.069475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a73c5e-7799-44ef-8da7-4fde7af777b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:53.070109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a73c5e-7799-44ef-8da7-4fde7af777b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:53.071958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a73c5e-7799-44ef-8da7-4fde7af777b6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:53.157324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def61b1c43f04bc28560924af29778c5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:53.158163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def61b1c43f04bc28560924af29778c5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:53.167751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def61b1c43f04bc28560924af29778c5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:53.170420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def61b1c43f04bc28560924af29778c5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:53.189581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1106/2170] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:53 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:53.190795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a73c5e-7799-44ef-8da7-4fde7af777b6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:53.192844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def61b1c43f04bc28560924af29778c5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:53.193890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-13a73c5e-7799-44ef-8da7-4fde7af777b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:53.278685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1065/2171] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:52 2022] DELETE /identity/v3/users/def61b1c43f04bc28560924af29778c5 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:53.286007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a73c5e-7799-44ef-8da7-4fde7af777b6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:53.373759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982d785-584f-4eab-bdfe-e2faa287b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:53.374580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d785-584f-4eab-bdfe-e2faa287b7bb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:53.374917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d785-584f-4eab-bdfe-e2faa287b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:53.375392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982d785-584f-4eab-bdfe-e2faa287b7bb admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:53.376141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982d785-584f-4eab-bdfe-e2faa287b7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:53.382696 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982d785-584f-4eab-bdfe-e2faa287b7bb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:53.494250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1107/2172] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:53 2022] POST /identity/v3/users => generated 287 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:53.498449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:53.508225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79350d-55ff-4d87-854b-cd6a0597537f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:53.512936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3f72b-819e-477f-b2db-00270284f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:53.513534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3f72b-819e-477f-b2db-00270284f20a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:53.513821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3f72b-819e-477f-b2db-00270284f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:53.514122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3f72b-819e-477f-b2db-00270284f20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:53.514774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3f72b-819e-477f-b2db-00270284f20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:53.516406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3f72b-819e-477f-b2db-00270284f20a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:53.526094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1066/2173] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:53.530630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982d785-584f-4eab-bdfe-e2faa287b7bb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:53.542334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982d785-584f-4eab-bdfe-e2faa287b7bb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:53.547558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c11fb9-c57e-4dc6-94c6-0fe2d869ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:53.548274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11fb9-c57e-4dc6-94c6-0fe2d869ffba admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:53.548553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11fb9-c57e-4dc6-94c6-0fe2d869ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:53.548831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11fb9-c57e-4dc6-94c6-0fe2d869ffba admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:53.550455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c11fb9-c57e-4dc6-94c6-0fe2d869ffba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:53.551291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c11fb9-c57e-4dc6-94c6-0fe2d869ffba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:53.562798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1108/2174] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:53.566978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3f72b-819e-477f-b2db-00270284f20a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:53.577439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3f72b-819e-477f-b2db-00270284f20a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:53.583732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03daad-bedb-4762-b5ae-5e32875e0aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:53.584489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03daad-bedb-4762-b5ae-5e32875e0aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:53.584857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03daad-bedb-4762-b5ae-5e32875e0aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:53.585312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03daad-bedb-4762-b5ae-5e32875e0aaf admin admin] PATH_INFO: `/v3/projects/6465962fd38643dabd79f7f973ed6407/users/22f0f2fbcc6048ab91bf96fc938f4055/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:53.606341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03daad-bedb-4762-b5ae-5e32875e0aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6465962fd38643dabd79f7f973ed6407, user_id=22f0f2fbcc6048ab91bf96fc938f4055, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:53.609832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03daad-bedb-4762-b5ae-5e32875e0aaf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:53.660302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1067/2175] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:53 2022] PUT /identity/v3/projects/6465962fd38643dabd79f7f973ed6407/users/22f0f2fbcc6048ab91bf96fc938f4055/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:53.671319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e723e-04b9-44f2-b8f4-a4ee11114e33 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:53.671838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e723e-04b9-44f2-b8f4-a4ee11114e33 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:53.672122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e723e-04b9-44f2-b8f4-a4ee11114e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:53.704674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-715e723e-04b9-44f2-b8f4-a4ee11114e33 None None] MFA Rules not processed for user `22f0f2fbcc6048ab91bf96fc938f4055`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:53.705914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-715e723e-04b9-44f2-b8f4-a4ee11114e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:53.787368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1109/2176] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:53.798981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03daad-bedb-4762-b5ae-5e32875e0aaf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:53.800752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc03daad-bedb-4762-b5ae-5e32875e0aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:53.859948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e723e-04b9-44f2-b8f4-a4ee11114e33 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:53.863140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03daad-bedb-4762-b5ae-5e32875e0aaf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:53.866659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-715e723e-04b9-44f2-b8f4-a4ee11114e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:53.867645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7b4ec-4fdb-4a7e-ab68-9a89602990a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:53.868470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7b4ec-4fdb-4a7e-ab68-9a89602990a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:53.868920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7b4ec-4fdb-4a7e-ab68-9a89602990a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:53.869397 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7b4ec-4fdb-4a7e-ab68-9a89602990a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:53.879306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7b4ec-4fdb-4a7e-ab68-9a89602990a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:53.880885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7b4ec-4fdb-4a7e-ab68-9a89602990a0 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:53.893125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1068/2177] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:54.009770 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e723e-04b9-44f2-b8f4-a4ee11114e33 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:54.023923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:54.038150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:54.040230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:54.040512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] PATH_INFO: `/v3/projects/bb092497d58e49c98f02f9964b88bd6b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:54.041861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb092497d58e49c98f02f9964b88bd6b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:54.049117 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:54.222748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb092497d58e49c98f02f9964b88bd6b', 'request_id': 'req-62fcccec-f0c0-4d76-b503-f3034f0ec63f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:54.229185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb092497d58e49c98f02f9964b88bd6b', 'request_id': 'req-62fcccec-f0c0-4d76-b503-f3034f0ec63f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:54.465390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb092497d58e49c98f02f9964b88bd6b', 'request_id': 'req-62fcccec-f0c0-4d76-b503-f3034f0ec63f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:54.477385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:54.480699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] The token cache is being invalidate because project bb092497d58e49c98f02f9964b88bd6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:54.481065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:54.482894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-62fcccec-f0c0-4d76-b503-f3034f0ec63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:54.488089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1110/2178] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:53 2022] DELETE /identity/v3/projects/bb092497d58e49c98f02f9964b88bd6b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:54.490529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d14293-cbfb-461e-b48c-cd42fc03aa3e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:54.490824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d14293-cbfb-461e-b48c-cd42fc03aa3e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:54.491130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d14293-cbfb-461e-b48c-cd42fc03aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:54.512923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-91d14293-cbfb-461e-b48c-cd42fc03aa3e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:54.514251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-91d14293-cbfb-461e-b48c-cd42fc03aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:54.582020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1069/2179] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:54.589326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6ba10-d593-4d1f-a4f9-aa7922784d67 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:54.619233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6ba10-d593-4d1f-a4f9-aa7922784d67 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:54.619233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6ba10-d593-4d1f-a4f9-aa7922784d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:54.619233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-92b6ba10-d593-4d1f-a4f9-aa7922784d67 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:54.619233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-92b6ba10-d593-4d1f-a4f9-aa7922784d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:54.628138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1111/2180] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:54.632569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d14293-cbfb-461e-b48c-cd42fc03aa3e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:54.650193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d14293-cbfb-461e-b48c-cd42fc03aa3e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:54.768912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7efdc4-3edc-4562-b1ca-23b7d27f340f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:54.768912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7efdc4-3edc-4562-b1ca-23b7d27f340f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:54.768912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7efdc4-3edc-4562-b1ca-23b7d27f340f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:54.768912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7efdc4-3edc-4562-b1ca-23b7d27f340f admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:54.770547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7efdc4-3edc-4562-b1ca-23b7d27f340f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:54.770547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7efdc4-3edc-4562-b1ca-23b7d27f340f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:54.770547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7efdc4-3edc-4562-b1ca-23b7d27f340f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:54.770547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1070/2181] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:54.771989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6ba10-d593-4d1f-a4f9-aa7922784d67 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:54.782030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6ba10-d593-4d1f-a4f9-aa7922784d67 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:54.786891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa1b0-80ee-46aa-a2ba-7f6099fe437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:54.787519 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa1b0-80ee-46aa-a2ba-7f6099fe437e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:54.787828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa1b0-80ee-46aa-a2ba-7f6099fe437e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:54.788106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa1b0-80ee-46aa-a2ba-7f6099fe437e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:54.788741 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8aa1b0-80ee-46aa-a2ba-7f6099fe437e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:54.790691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8aa1b0-80ee-46aa-a2ba-7f6099fe437e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:54.932810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1112/2182] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:54 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:54.939794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7efdc4-3edc-4562-b1ca-23b7d27f340f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:54.954507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7efdc4-3edc-4562-b1ca-23b7d27f340f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:55.013084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3c307-ad28-4550-917b-6dddfef1335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:55.013726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c307-ad28-4550-917b-6dddfef1335a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:55.014004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c307-ad28-4550-917b-6dddfef1335a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:55.014307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c307-ad28-4550-917b-6dddfef1335a admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:55.014942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c307-ad28-4550-917b-6dddfef1335a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:55.016901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c307-ad28-4550-917b-6dddfef1335a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:55.154464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1071/2183] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:54 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:55.156680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa1b0-80ee-46aa-a2ba-7f6099fe437e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:55.167250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa1b0-80ee-46aa-a2ba-7f6099fe437e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:55.176295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:55.178192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b287687-3b93-4346-afe7-e78c02e8572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:55.183092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b287687-3b93-4346-afe7-e78c02e8572a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:55.183092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b287687-3b93-4346-afe7-e78c02e8572a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:55.183092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b287687-3b93-4346-afe7-e78c02e8572a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:55.183092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b287687-3b93-4346-afe7-e78c02e8572a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:55.183092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b287687-3b93-4346-afe7-e78c02e8572a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:55.193232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1113/2184] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:55.198555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3c307-ad28-4550-917b-6dddfef1335a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:55.214596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3c307-ad28-4550-917b-6dddfef1335a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:55.222036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ec883-27ce-4e3a-8010-93f29506abd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:55.222688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ec883-27ce-4e3a-8010-93f29506abd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:55.222976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ec883-27ce-4e3a-8010-93f29506abd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:55.223259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ec883-27ce-4e3a-8010-93f29506abd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:55.224107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ec883-27ce-4e3a-8010-93f29506abd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:55.225691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ec883-27ce-4e3a-8010-93f29506abd4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:55.237822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1072/2185] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:55.246702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b287687-3b93-4346-afe7-e78c02e8572a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:55.259328 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b287687-3b93-4346-afe7-e78c02e8572a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:55.266574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5303e7-c03a-481d-a30e-2a954237c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:55.267247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5303e7-c03a-481d-a30e-2a954237c2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:55.267526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5303e7-c03a-481d-a30e-2a954237c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:55.267796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5303e7-c03a-481d-a30e-2a954237c2f8 admin admin] PATH_INFO: `/v3/projects/51c870aec24a4ae0906e62545553994b/users/04ae679ba495459f9d6922bef0299104/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:55.304052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5303e7-c03a-481d-a30e-2a954237c2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c870aec24a4ae0906e62545553994b, user_id=04ae679ba495459f9d6922bef0299104, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:55.307716 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5303e7-c03a-481d-a30e-2a954237c2f8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:55.432074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1114/2186] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:55 2022] PUT /identity/v3/projects/51c870aec24a4ae0906e62545553994b/users/04ae679ba495459f9d6922bef0299104/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:55.442732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e8bb-b162-48d1-8eb9-28b859cfecea None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:55.443096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e8bb-b162-48d1-8eb9-28b859cfecea None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:55.443444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7e8bb-b162-48d1-8eb9-28b859cfecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:55.473398 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-26a7e8bb-b162-48d1-8eb9-28b859cfecea None None] MFA Rules not processed for user `04ae679ba495459f9d6922bef0299104`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:55.474729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-26a7e8bb-b162-48d1-8eb9-28b859cfecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:55.554169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1073/2187] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:55.559290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5303e7-c03a-481d-a30e-2a954237c2f8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:55.630110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5303e7-c03a-481d-a30e-2a954237c2f8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:55.635529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cb1bc-90ed-492c-9664-43d849ad2a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:55.636120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cb1bc-90ed-492c-9664-43d849ad2a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:55.636403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cb1bc-90ed-492c-9664-43d849ad2a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:55.636931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cb1bc-90ed-492c-9664-43d849ad2a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:55.637537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cb1bc-90ed-492c-9664-43d849ad2a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:55.640073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cb1bc-90ed-492c-9664-43d849ad2a51 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:55.735256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1115/2188] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:55 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:55.739454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7e8bb-b162-48d1-8eb9-28b859cfecea None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:55.751297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7e8bb-b162-48d1-8eb9-28b859cfecea None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:55.808834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0b80-3b13-46db-8876-841605f36ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:55.809552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0b80-3b13-46db-8876-841605f36ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:55.809834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0b80-3b13-46db-8876-841605f36ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:55.810651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e0b80-3b13-46db-8876-841605f36ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:55.811307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e0b80-3b13-46db-8876-841605f36ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:55.813304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e0b80-3b13-46db-8876-841605f36ce5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:55.894474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1074/2189] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:55 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:55.898850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cb1bc-90ed-492c-9664-43d849ad2a51 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:55.911031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cb1bc-90ed-492c-9664-43d849ad2a51 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:55.916784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07e097-3a87-4d4c-a506-0e39d3433027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:55.917413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07e097-3a87-4d4c-a506-0e39d3433027 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:55.917693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07e097-3a87-4d4c-a506-0e39d3433027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:55.917982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07e097-3a87-4d4c-a506-0e39d3433027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:55.918667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07e097-3a87-4d4c-a506-0e39d3433027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:55.921105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07e097-3a87-4d4c-a506-0e39d3433027 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:55.940129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1116/2190] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:55.944531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0b80-3b13-46db-8876-841605f36ce5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:55.957502 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e0b80-3b13-46db-8876-841605f36ce5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:55.962414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c84dff-5504-4a53-a733-234bdeccbda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:55.963094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c84dff-5504-4a53-a733-234bdeccbda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:55.963375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c84dff-5504-4a53-a733-234bdeccbda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:55.963653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c84dff-5504-4a53-a733-234bdeccbda4 admin admin] PATH_INFO: `/v3/projects/dbea354071cf457fa26a6c7021720cc4/users/026e79e0db444221b895a7e75a1a7af0/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:55.980197 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c84dff-5504-4a53-a733-234bdeccbda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbea354071cf457fa26a6c7021720cc4, user_id=026e79e0db444221b895a7e75a1a7af0, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:55.983405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c84dff-5504-4a53-a733-234bdeccbda4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:56.091617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1075/2191] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:55 2022] PUT /identity/v3/projects/dbea354071cf457fa26a6c7021720cc4/users/026e79e0db444221b895a7e75a1a7af0/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:56.092689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07e097-3a87-4d4c-a506-0e39d3433027 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:56.105236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07e097-3a87-4d4c-a506-0e39d3433027 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:56.187322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830e58e-6594-4def-ac5e-b31d49eef08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:56.187958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830e58e-6594-4def-ac5e-b31d49eef08a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:56.188240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830e58e-6594-4def-ac5e-b31d49eef08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:56.190179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830e58e-6594-4def-ac5e-b31d49eef08a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:56.193746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830e58e-6594-4def-ac5e-b31d49eef08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:56.193746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830e58e-6594-4def-ac5e-b31d49eef08a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:56.208722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1117/2192] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:56.213046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c84dff-5504-4a53-a733-234bdeccbda4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:56.225599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c84dff-5504-4a53-a733-234bdeccbda4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:56.235098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579a700-b008-4400-84ea-2adc4a2e3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:56.235791 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579a700-b008-4400-84ea-2adc4a2e3954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:56.236073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579a700-b008-4400-84ea-2adc4a2e3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:56.236381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579a700-b008-4400-84ea-2adc4a2e3954 admin admin] PATH_INFO: `/v3/projects/dbea354071cf457fa26a6c7021720cc4/users/026e79e0db444221b895a7e75a1a7af0/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:56.238694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579a700-b008-4400-84ea-2adc4a2e3954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbea354071cf457fa26a6c7021720cc4, user_id=026e79e0db444221b895a7e75a1a7af0, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:56.241454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579a700-b008-4400-84ea-2adc4a2e3954 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:56.254548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1076/2193] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:56 2022] PUT /identity/v3/projects/dbea354071cf457fa26a6c7021720cc4/users/026e79e0db444221b895a7e75a1a7af0/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:56.266220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cabed-ca61-4522-aba0-613b12c834c9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:56.266543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cabed-ca61-4522-aba0-613b12c834c9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:56.267095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cabed-ca61-4522-aba0-613b12c834c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:56.302636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fe6cabed-ca61-4522-aba0-613b12c834c9 None None] MFA Rules not processed for user `026e79e0db444221b895a7e75a1a7af0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:56.312759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fe6cabed-ca61-4522-aba0-613b12c834c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:56.402634 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1118/2194] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:56.415773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579a700-b008-4400-84ea-2adc4a2e3954 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:56.417878 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2579a700-b008-4400-84ea-2adc4a2e3954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:56.517895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579a700-b008-4400-84ea-2adc4a2e3954 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:56.522364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff40b36-6e11-4e16-92de-3e0fd89e87e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:56.522941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff40b36-6e11-4e16-92de-3e0fd89e87e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:56.523224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff40b36-6e11-4e16-92de-3e0fd89e87e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:56.523503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff40b36-6e11-4e16-92de-3e0fd89e87e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:56.533891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff40b36-6e11-4e16-92de-3e0fd89e87e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:56.535439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff40b36-6e11-4e16-92de-3e0fd89e87e0 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:56.549536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1077/2195] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:56.593719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed2c9-67e2-41fe-a53e-19c9ecf9a613 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:56.593998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed2c9-67e2-41fe-a53e-19c9ecf9a613 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:56.594410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed2c9-67e2-41fe-a53e-19c9ecf9a613 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:56.602826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1119/2196] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:02:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:02:56.614184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3cf7-bc1d-45d8-9212-f15154bbff52 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:56.614610 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3cf7-bc1d-45d8-9212-f15154bbff52 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:56.614694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3cf7-bc1d-45d8-9212-f15154bbff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:56.650925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-feee3cf7-bc1d-45d8-9212-f15154bbff52 None None] MFA Rules not processed for user `efba357340ac47dca0b1742d4e04fd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:56.652522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-feee3cf7-bc1d-45d8-9212-f15154bbff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:56.690140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ed2c9-67e2-41fe-a53e-19c9ecf9a613 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:56.706529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ed2c9-67e2-41fe-a53e-19c9ecf9a613 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:56.710284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ca1bb-22aa-43b6-b448-3aaaab9b5072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:56.711058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca1bb-22aa-43b6-b448-3aaaab9b5072 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:56.712167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca1bb-22aa-43b6-b448-3aaaab9b5072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:56.712528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ca1bb-22aa-43b6-b448-3aaaab9b5072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:56.748289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1078/2197] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:02:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:56.762222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3cf7-bc1d-45d8-9212-f15154bbff52 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:56.766317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-feee3cf7-bc1d-45d8-9212-f15154bbff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:56.793474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3cf7-bc1d-45d8-9212-f15154bbff52 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:56.812043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0da26d-9251-4396-952c-10551c6313c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:56.812607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ca1bb-22aa-43b6-b448-3aaaab9b5072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:56.812767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0da26d-9251-4396-952c-10551c6313c2 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:56.813035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0da26d-9251-4396-952c-10551c6313c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:56.813372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0da26d-9251-4396-952c-10551c6313c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:56.816909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ca1bb-22aa-43b6-b448-3aaaab9b5072 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:56.824261 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0da26d-9251-4396-952c-10551c6313c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:56.828411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0da26d-9251-4396-952c-10551c6313c2 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:56.832572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1120/2198] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:56.864582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1079/2199] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:57.605325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ca1bb-22aa-43b6-b448-3aaaab9b5072 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:57.612943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ff3ca1bb-22aa-43b6-b448-3aaaab9b5072 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:57.812066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ca1bb-22aa-43b6-b448-3aaaab9b5072 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:57.818205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:57.819377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:57.819948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:57.820380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] PATH_INFO: `/v3/users/c1b2fa1ad837485e8485417c986fcf0f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:57.822179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b2fa1ad837485e8485417c986fcf0f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:57.824533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:57.995706 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:58.123557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b2fa1ad837485e8485417c986fcf0f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.124226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b2fa1ad837485e8485417c986fcf0f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.131726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b2fa1ad837485e8485417c986fcf0f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.218977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b2fa1ad837485e8485417c986fcf0f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.220335 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b2fa1ad837485e8485417c986fcf0f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.246796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1121/2200] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:57 2022] DELETE /identity/v3/users/c1b2fa1ad837485e8485417c986fcf0f => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:58.511790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:58.569813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0da26d-9251-4396-952c-10551c6313c2 service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:58.588863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0da26d-9251-4396-952c-10551c6313c2 service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:58.666727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:58.667601 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:58.667938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:58.675865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] PATH_INFO: `/v3/projects/3dcb57951821450aa05d433659dde16d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:58.675865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcb57951821450aa05d433659dde16d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:58.675865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:58.817183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcb57951821450aa05d433659dde16d', 'request_id': 'req-56e2e2df-7519-4af5-9629-cc1961c9325e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.824338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcb57951821450aa05d433659dde16d', 'request_id': 'req-56e2e2df-7519-4af5-9629-cc1961c9325e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.837202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcb57951821450aa05d433659dde16d', 'request_id': 'req-56e2e2df-7519-4af5-9629-cc1961c9325e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.977346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] The token cache is being invalidate because project 3dcb57951821450aa05d433659dde16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:58.977691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.981272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:58.991968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:58.993455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:58.995234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1080/2201] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:58 2022] DELETE /identity/v3/projects/3dcb57951821450aa05d433659dde16d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:59.024860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d2841-b633-4f52-a7fd-6a1c8a3d0932 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:59.119566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:59.120386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:59.120899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:59.121363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] PATH_INFO: `/v3/users/f49f128f82d3459b83ee0cdea7437a49` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:59.129005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49f128f82d3459b83ee0cdea7437a49)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:59.141986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:59.344221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49f128f82d3459b83ee0cdea7437a49'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.344945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49f128f82d3459b83ee0cdea7437a49'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.353174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49f128f82d3459b83ee0cdea7437a49'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.417319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:59.422655 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:59.437421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2e2df-7519-4af5-9629-cc1961c9325e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:59.442303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:59.443287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:59.443287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:59.443525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] PATH_INFO: `/v3/users/22f0f2fbcc6048ab91bf96fc938f4055` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:59.444683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f0f2fbcc6048ab91bf96fc938f4055)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:59.448054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:59.448502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49f128f82d3459b83ee0cdea7437a49'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.449140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1305f5a3-bb10-4906-a460-28f46fa5edbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49f128f82d3459b83ee0cdea7437a49'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.483318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1122/2202] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:58 2022] DELETE /identity/v3/users/f49f128f82d3459b83ee0cdea7437a49 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:59.617121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f0f2fbcc6048ab91bf96fc938f4055'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.618024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f0f2fbcc6048ab91bf96fc938f4055'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.627058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f0f2fbcc6048ab91bf96fc938f4055'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.627769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f0f2fbcc6048ab91bf96fc938f4055'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.644695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f0f2fbcc6048ab91bf96fc938f4055'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:59.716131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1081/2203] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:59 2022] DELETE /identity/v3/users/22f0f2fbcc6048ab91bf96fc938f4055 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:59.720756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c294145-ef49-476c-8eb1-7989b4f10aec None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:59.721050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c294145-ef49-476c-8eb1-7989b4f10aec None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:59.721330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c294145-ef49-476c-8eb1-7989b4f10aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:59.741210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2c294145-ef49-476c-8eb1-7989b4f10aec None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:59.742451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2c294145-ef49-476c-8eb1-7989b4f10aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:59.770607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:59.772430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:59.826874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1123/2204] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:59.840573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c294145-ef49-476c-8eb1-7989b4f10aec None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:59.842750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2c294145-ef49-476c-8eb1-7989b4f10aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:59.868949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a0e99-0102-4825-b68f-27957bb6696c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:59.874900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:59.875607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:59.876001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:59.876358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] PATH_INFO: `/v3/projects/faf71b1146c642638286cb94308c99c8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:59.877648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf71b1146c642638286cb94308c99c8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:59.879682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:59.907050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c294145-ef49-476c-8eb1-7989b4f10aec None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:59.910850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44e3b6-989d-49af-82dd-926926822e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:59.914878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44e3b6-989d-49af-82dd-926926822e8f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:59.914878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44e3b6-989d-49af-82dd-926926822e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:59.914878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44e3b6-989d-49af-82dd-926926822e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:59.921956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44e3b6-989d-49af-82dd-926926822e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:59.923471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44e3b6-989d-49af-82dd-926926822e8f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:59.934427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1124/2205] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:59.962361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:00.031340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf71b1146c642638286cb94308c99c8', 'request_id': 'req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.038413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf71b1146c642638286cb94308c99c8', 'request_id': 'req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.045183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf71b1146c642638286cb94308c99c8', 'request_id': 'req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.121105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] The token cache is being invalidate because project faf71b1146c642638286cb94308c99c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:00.122068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.122068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-03f5bea2-f8c4-4b04-b7b4-dbebf0524066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.123632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1082/2206] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:59 2022] DELETE /identity/v3/projects/faf71b1146c642638286cb94308c99c8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:00.128526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb150d7e-0661-4208-9e61-b59ed61cff77 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:00.128978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb150d7e-0661-4208-9e61-b59ed61cff77 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:00.129106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb150d7e-0661-4208-9e61-b59ed61cff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:00.149128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bb150d7e-0661-4208-9e61-b59ed61cff77 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:00.150639 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bb150d7e-0661-4208-9e61-b59ed61cff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:00.245521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1125/2207] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:00.254304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611cf62-9823-4d18-91e0-f61f3d25cead None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:00.254956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611cf62-9823-4d18-91e0-f61f3d25cead None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:00.255294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611cf62-9823-4d18-91e0-f61f3d25cead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:00.275964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f611cf62-9823-4d18-91e0-f61f3d25cead None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:00.277342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f611cf62-9823-4d18-91e0-f61f3d25cead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:00.287058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1083/2208] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:00.291213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb150d7e-0661-4208-9e61-b59ed61cff77 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:00.308636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb150d7e-0661-4208-9e61-b59ed61cff77 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:00.313853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:00.314741 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:00.315124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:00.315954 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:00.316204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:00.318265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:00.320662 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:00.336666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1126/2209] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:00.341520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611cf62-9823-4d18-91e0-f61f3d25cead None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:00.351676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611cf62-9823-4d18-91e0-f61f3d25cead None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:00.357914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9975f-8190-4611-923f-9abe41b5fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:00.358574 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9975f-8190-4611-923f-9abe41b5fb82 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:00.358900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9975f-8190-4611-923f-9abe41b5fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:00.359185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9975f-8190-4611-923f-9abe41b5fb82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:00.359836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9975f-8190-4611-923f-9abe41b5fb82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:00.363182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9975f-8190-4611-923f-9abe41b5fb82 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:00.414855 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:00.416875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:00.432737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d80c3-9636-4fb6-91bc-3b78e25044d2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:00.441122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:00.442036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:00.442443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:00.442813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] PATH_INFO: `/v3/users/04ae679ba495459f9d6922bef0299104` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:00.444453 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ae679ba495459f9d6922bef0299104)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:00.446830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:00.463732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1084/2210] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:00 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:00.467061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9975f-8190-4611-923f-9abe41b5fb82 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:00.467171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cac9975f-8190-4611-923f-9abe41b5fb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:00.536039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9975f-8190-4611-923f-9abe41b5fb82 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:00.540756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:00.541401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:00.541682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:00.541972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] PATH_INFO: `/v3/projects/6465962fd38643dabd79f7f973ed6407` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:00.543317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6465962fd38643dabd79f7f973ed6407)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:00.545269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:00.703438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ae679ba495459f9d6922bef0299104'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.704169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ae679ba495459f9d6922bef0299104'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.713567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ae679ba495459f9d6922bef0299104'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.715244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6465962fd38643dabd79f7f973ed6407', 'request_id': 'req-9e98c584-94d3-44f7-af17-98c33ae84709'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.724059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6465962fd38643dabd79f7f973ed6407', 'request_id': 'req-9e98c584-94d3-44f7-af17-98c33ae84709'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.730813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6465962fd38643dabd79f7f973ed6407', 'request_id': 'req-9e98c584-94d3-44f7-af17-98c33ae84709'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.807187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ae679ba495459f9d6922bef0299104'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.808149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ae679ba495459f9d6922bef0299104'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.819490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:00.829287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1127/2211] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:00 2022] DELETE /identity/v3/users/04ae679ba495459f9d6922bef0299104 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:00.832468 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:00.833299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:00.859137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] The token cache is being invalidate because project 6465962fd38643dabd79f7f973ed6407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:00.860924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.860924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9e98c584-94d3-44f7-af17-98c33ae84709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:00.863007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1085/2212] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:00 2022] DELETE /identity/v3/projects/6465962fd38643dabd79f7f973ed6407 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:00.864569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e99fb-d5fe-4c90-aba0-a98bf9f423f0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:00.864961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e99fb-d5fe-4c90-aba0-a98bf9f423f0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:00.865372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e99fb-d5fe-4c90-aba0-a98bf9f423f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:00.894530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bf1e99fb-d5fe-4c90-aba0-a98bf9f423f0 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:00.895766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bf1e99fb-d5fe-4c90-aba0-a98bf9f423f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:00.920145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c39c3-8584-4e11-9bb3-30eeec83696c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:00.925585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75b88e-85e9-4e42-8bd4-8f3f439a257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:00.926224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b88e-85e9-4e42-8bd4-8f3f439a257d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:00.926639 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b88e-85e9-4e42-8bd4-8f3f439a257d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:00.930162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75b88e-85e9-4e42-8bd4-8f3f439a257d admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:00.930162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75b88e-85e9-4e42-8bd4-8f3f439a257d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:00.930162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75b88e-85e9-4e42-8bd4-8f3f439a257d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:00.960883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1086/2213] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:00.962430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31579851-7616-4139-8f39-0fe5652bfb01 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:00.962858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31579851-7616-4139-8f39-0fe5652bfb01 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:00.963266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31579851-7616-4139-8f39-0fe5652bfb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:00.990557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-31579851-7616-4139-8f39-0fe5652bfb01 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:00.991767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-31579851-7616-4139-8f39-0fe5652bfb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:00.999686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1087/2214] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:01.000549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31579851-7616-4139-8f39-0fe5652bfb01 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.001875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-31579851-7616-4139-8f39-0fe5652bfb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:01.042322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1128/2215] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:00 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:01.044680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1776c3-bbc4-490f-b1e7-6a0f4848bf2d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.045103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1776c3-bbc4-490f-b1e7-6a0f4848bf2d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.045473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1776c3-bbc4-490f-b1e7-6a0f4848bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.063359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31579851-7616-4139-8f39-0fe5652bfb01 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.068098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb218f-f7a8-4bd3-a9be-8f9e13d2afbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.068098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb218f-f7a8-4bd3-a9be-8f9e13d2afbf service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.068098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb218f-f7a8-4bd3-a9be-8f9e13d2afbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.068497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb218f-f7a8-4bd3-a9be-8f9e13d2afbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.068931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-be1776c3-bbc4-490f-b1e7-6a0f4848bf2d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:01.074229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be1776c3-bbc4-490f-b1e7-6a0f4848bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:01.082626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1129/2216] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:01.083631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1776c3-bbc4-490f-b1e7-6a0f4848bf2d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.084935 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be1776c3-bbc4-490f-b1e7-6a0f4848bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:01.087121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb218f-f7a8-4bd3-a9be-8f9e13d2afbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.089201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb218f-f7a8-4bd3-a9be-8f9e13d2afbf service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.097676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1776c3-bbc4-490f-b1e7-6a0f4848bf2d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.099947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1088/2217] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:01.100732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb218f-f7a8-4bd3-a9be-8f9e13d2afbf service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.102498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c3de7-22f1-4593-b95f-841a6abf774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.103109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c3de7-22f1-4593-b95f-841a6abf774c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.103445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c3de7-22f1-4593-b95f-841a6abf774c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.103724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c3de7-22f1-4593-b95f-841a6abf774c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.104381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c3de7-22f1-4593-b95f-841a6abf774c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.106058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c3de7-22f1-4593-b95f-841a6abf774c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.110972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb218f-f7a8-4bd3-a9be-8f9e13d2afbf service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.116181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c3b32-cd21-4a4d-88fb-a58e9898c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.116739 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c3b32-cd21-4a4d-88fb-a58e9898c0bf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.117111 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c3b32-cd21-4a4d-88fb-a58e9898c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.117286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c3b32-cd21-4a4d-88fb-a58e9898c0bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.117935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c3b32-cd21-4a4d-88fb-a58e9898c0bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:01.118274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c3b32-cd21-4a4d-88fb-a58e9898c0bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.119013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1130/2218] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:01.120389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c3b32-cd21-4a4d-88fb-a58e9898c0bf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.123034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c3de7-22f1-4593-b95f-841a6abf774c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.132183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1089/2219] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:01.134820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c3de7-22f1-4593-b95f-841a6abf774c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.136679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c3b32-cd21-4a4d-88fb-a58e9898c0bf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.141316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099fa04-384f-4242-b8f9-4f3d2a882be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.141937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099fa04-384f-4242-b8f9-4f3d2a882be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.142255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099fa04-384f-4242-b8f9-4f3d2a882be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.143029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099fa04-384f-4242-b8f9-4f3d2a882be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.148750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c3b32-cd21-4a4d-88fb-a58e9898c0bf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.155547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099fa04-384f-4242-b8f9-4f3d2a882be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.156355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bfef-4b5c-480e-88c3-d1fc25a6c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.157354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bfef-4b5c-480e-88c3-d1fc25a6c795 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.157878 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bfef-4b5c-480e-88c3-d1fc25a6c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.158335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bfef-4b5c-480e-88c3-d1fc25a6c795 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.158708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099fa04-384f-4242-b8f9-4f3d2a882be3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.159321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bfef-4b5c-480e-88c3-d1fc25a6c795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.166577 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bfef-4b5c-480e-88c3-d1fc25a6c795 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.185235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1131/2220] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:01.189353 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099fa04-384f-4242-b8f9-4f3d2a882be3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.202975 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099fa04-384f-4242-b8f9-4f3d2a882be3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.209863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f099818-89bd-44ab-8016-8d5d1be13ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.210854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f099818-89bd-44ab-8016-8d5d1be13ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.211322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f099818-89bd-44ab-8016-8d5d1be13ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.212493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f099818-89bd-44ab-8016-8d5d1be13ba5 admin admin] PATH_INFO: `/v3/projects/ed97e0f129f14e9ebbacbe2cec8e60c2/users/874113b02d024e3da45316c6480f3d2a/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.230554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f099818-89bd-44ab-8016-8d5d1be13ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed97e0f129f14e9ebbacbe2cec8e60c2, user_id=874113b02d024e3da45316c6480f3d2a, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.233826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f099818-89bd-44ab-8016-8d5d1be13ba5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.277575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1090/2221] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:01 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:03:01.282285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bfef-4b5c-480e-88c3-d1fc25a6c795 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.356800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bfef-4b5c-480e-88c3-d1fc25a6c795 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.361947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f7083-1fd5-4b5d-a14c-45f45d1aadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.362601 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7083-1fd5-4b5d-a14c-45f45d1aadd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.362885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7083-1fd5-4b5d-a14c-45f45d1aadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.363160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f7083-1fd5-4b5d-a14c-45f45d1aadd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.366965 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7083-1fd5-4b5d-a14c-45f45d1aadd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.366965 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f7083-1fd5-4b5d-a14c-45f45d1aadd7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.373081 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1132/2222] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:01 2022] PUT /identity/v3/projects/ed97e0f129f14e9ebbacbe2cec8e60c2/users/874113b02d024e3da45316c6480f3d2a/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:01.382209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb96f1-53e6-4b61-8228-1e6c11db0e69 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.382630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb96f1-53e6-4b61-8228-1e6c11db0e69 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.383075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb96f1-53e6-4b61-8228-1e6c11db0e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.425658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-16bb96f1-53e6-4b61-8228-1e6c11db0e69 None None] MFA Rules not processed for user `874113b02d024e3da45316c6480f3d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:01.425861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-16bb96f1-53e6-4b61-8228-1e6c11db0e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:01.455724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1091/2223] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:01 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:03:01.457540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b115a-a1ce-4c27-9e2e-587b6e2ff797 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.457834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b115a-a1ce-4c27-9e2e-587b6e2ff797 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.458126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b115a-a1ce-4c27-9e2e-587b6e2ff797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.490553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-949b115a-a1ce-4c27-9e2e-587b6e2ff797 None None] MFA Rules not processed for user `25274e19c10c4e8fb35b37f06e6bfdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:01.494348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-949b115a-a1ce-4c27-9e2e-587b6e2ff797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:01.535132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:01.546951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1133/2224] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:03:01.547360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb96f1-53e6-4b61-8228-1e6c11db0e69 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.563077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1092/2225] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:01.569423 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b115a-a1ce-4c27-9e2e-587b6e2ff797 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.603965 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:01.693320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b115a-a1ce-4c27-9e2e-587b6e2ff797 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.695731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb96f1-53e6-4b61-8228-1e6c11db0e69 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.698649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f972-8fe4-4176-8614-9de345fdd33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.699276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f972-8fe4-4176-8614-9de345fdd33b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.699568 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f972-8fe4-4176-8614-9de345fdd33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.699907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f972-8fe4-4176-8614-9de345fdd33b admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.701031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36f972-8fe4-4176-8614-9de345fdd33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.701842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3e982-5aea-43f3-9736-19c0217e3c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.702571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3e982-5aea-43f3-9736-19c0217e3c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.706370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3e982-5aea-43f3-9736-19c0217e3c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.706483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36f972-8fe4-4176-8614-9de345fdd33b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.706570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3e982-5aea-43f3-9736-19c0217e3c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.706570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3e982-5aea-43f3-9736-19c0217e3c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.706570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3e982-5aea-43f3-9736-19c0217e3c61 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.719173 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1134/2226] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:01.720434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3e982-5aea-43f3-9736-19c0217e3c61 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.734649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3e982-5aea-43f3-9736-19c0217e3c61 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.740270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6794-b4c0-4b3b-a59f-f68891661119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.740905 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6794-b4c0-4b3b-a59f-f68891661119 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.741188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6794-b4c0-4b3b-a59f-f68891661119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.741474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c6794-b4c0-4b3b-a59f-f68891661119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.742171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c6794-b4c0-4b3b-a59f-f68891661119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.743937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c6794-b4c0-4b3b-a59f-f68891661119 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.761834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1135/2227] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:01.761834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6794-b4c0-4b3b-a59f-f68891661119 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.764700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a65c6794-b4c0-4b3b-a59f-f68891661119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:01.779823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c6794-b4c0-4b3b-a59f-f68891661119 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.787610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.788423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.788803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.789083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] PATH_INFO: `/v3/projects/51c870aec24a4ae0906e62545553994b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.794341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c870aec24a4ae0906e62545553994b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.796840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.808480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1093/2228] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:01 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:01.808480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f972-8fe4-4176-8614-9de345fdd33b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:01.888831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f972-8fe4-4176-8614-9de345fdd33b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:01.893470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032936b5-7a5f-451a-a30b-fc99e54f42c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:01.893470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032936b5-7a5f-451a-a30b-fc99e54f42c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:01.893470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032936b5-7a5f-451a-a30b-fc99e54f42c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:01.893470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032936b5-7a5f-451a-a30b-fc99e54f42c5 admin admin] PATH_INFO: `/v3/projects/b6e524d857f04c9ca88f9cd87ef70c83/users/1b5312aefc1b44f8bcbd3c64499b23d9/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:01.909298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032936b5-7a5f-451a-a30b-fc99e54f42c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e524d857f04c9ca88f9cd87ef70c83, user_id=1b5312aefc1b44f8bcbd3c64499b23d9, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:01.912000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032936b5-7a5f-451a-a30b-fc99e54f42c5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:01.930734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c870aec24a4ae0906e62545553994b', 'request_id': 'req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:01.947295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c870aec24a4ae0906e62545553994b', 'request_id': 'req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:01.999439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1094/2229] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:01 2022] PUT /identity/v3/projects/b6e524d857f04c9ca88f9cd87ef70c83/users/1b5312aefc1b44f8bcbd3c64499b23d9/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:02.000361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032936b5-7a5f-451a-a30b-fc99e54f42c5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.019337 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c870aec24a4ae0906e62545553994b', 'request_id': 'req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:02.041524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] The token cache is being invalidate because project 51c870aec24a4ae0906e62545553994b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:02.042043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:02.043386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b3dc85fe-fcac-45dd-8c60-65facf9c8c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:02.045241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1136/2230] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:01 2022] DELETE /identity/v3/projects/51c870aec24a4ae0906e62545553994b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:02.046814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e004-8af1-43cc-aea5-4d28905b012f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.046997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e004-8af1-43cc-aea5-4d28905b012f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.047409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8e004-8af1-43cc-aea5-4d28905b012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.093176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e4e8e004-8af1-43cc-aea5-4d28905b012f None None] MFA Rules not processed for user `1b5312aefc1b44f8bcbd3c64499b23d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:02.094448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e4e8e004-8af1-43cc-aea5-4d28905b012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:02.119115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032936b5-7a5f-451a-a30b-fc99e54f42c5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.125468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a0a1f-ba5f-4d6c-93f6-93d5e765aefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.127422 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a0a1f-ba5f-4d6c-93f6-93d5e765aefd admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.127705 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a0a1f-ba5f-4d6c-93f6-93d5e765aefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.127977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a0a1f-ba5f-4d6c-93f6-93d5e765aefd admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.128623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a0a1f-ba5f-4d6c-93f6-93d5e765aefd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.130587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a0a1f-ba5f-4d6c-93f6-93d5e765aefd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.175514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1137/2231] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:02.176527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8e004-8af1-43cc-aea5-4d28905b012f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.180829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e4e8e004-8af1-43cc-aea5-4d28905b012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:02.197656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8e004-8af1-43cc-aea5-4d28905b012f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.203854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.204499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.204787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.205118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] PATH_INFO: `/v3/users/026e79e0db444221b895a7e75a1a7af0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.206393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026e79e0db444221b895a7e75a1a7af0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.208490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.271506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1095/2232] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:01 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:02.272388 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a0a1f-ba5f-4d6c-93f6-93d5e765aefd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.274062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5d7a0a1f-ba5f-4d6c-93f6-93d5e765aefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:02.282653 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:02.286872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a0a1f-ba5f-4d6c-93f6-93d5e765aefd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.292509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf605de-a4ca-4ebc-a7da-d8a95224a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.292689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf605de-a4ca-4ebc-a7da-d8a95224a61b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.293523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf605de-a4ca-4ebc-a7da-d8a95224a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.293807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf605de-a4ca-4ebc-a7da-d8a95224a61b admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.294685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf605de-a4ca-4ebc-a7da-d8a95224a61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.296733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf605de-a4ca-4ebc-a7da-d8a95224a61b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.412052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1096/2233] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:02 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:02.412052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf605de-a4ca-4ebc-a7da-d8a95224a61b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.412310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dcf605de-a4ca-4ebc-a7da-d8a95224a61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:02.456868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026e79e0db444221b895a7e75a1a7af0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:02.457866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026e79e0db444221b895a7e75a1a7af0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:02.466611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026e79e0db444221b895a7e75a1a7af0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:02.506920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf605de-a4ca-4ebc-a7da-d8a95224a61b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.511880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9164-8e13-4c0c-ab2d-85c9bfe681ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.512494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9164-8e13-4c0c-ab2d-85c9bfe681ba admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.512830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9164-8e13-4c0c-ab2d-85c9bfe681ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.513106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9164-8e13-4c0c-ab2d-85c9bfe681ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.513858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9164-8e13-4c0c-ab2d-85c9bfe681ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.515541 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9164-8e13-4c0c-ab2d-85c9bfe681ba admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.525361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1097/2234] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:02.526171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9164-8e13-4c0c-ab2d-85c9bfe681ba admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.536101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9164-8e13-4c0c-ab2d-85c9bfe681ba admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.540838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c0927-cece-448b-8118-58d1bde408ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.541368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c0927-cece-448b-8118-58d1bde408ca admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.541651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c0927-cece-448b-8118-58d1bde408ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.541921 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c0927-cece-448b-8118-58d1bde408ca admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.542451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026e79e0db444221b895a7e75a1a7af0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:02.542598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c0927-cece-448b-8118-58d1bde408ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.545200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c0927-cece-448b-8118-58d1bde408ca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.545947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026e79e0db444221b895a7e75a1a7af0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:02.569153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:02.581503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1138/2235] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:02 2022] DELETE /identity/v3/users/026e79e0db444221b895a7e75a1a7af0 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:02.582609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.583776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:02.628175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1098/2236] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:02 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:02.632044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c0927-cece-448b-8118-58d1bde408ca admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.634548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d93c0927-cece-448b-8118-58d1bde408ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:02.665749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c0927-cece-448b-8118-58d1bde408ca admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.672419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dccee-6237-4b07-85a0-c25ab5f0eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.679960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dccee-6237-4b07-85a0-c25ab5f0eab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.679960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dccee-6237-4b07-85a0-c25ab5f0eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.679960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dccee-6237-4b07-85a0-c25ab5f0eab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.679960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dccee-6237-4b07-85a0-c25ab5f0eab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.680361 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaaa90-1264-4f0d-9c09-791eedb67c25 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.680442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dccee-6237-4b07-85a0-c25ab5f0eab3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.692240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb09d1a-bc64-4cfc-950c-94333cc5dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.692451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1099/2237] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:02.692852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb09d1a-bc64-4cfc-950c-94333cc5dc99 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.693134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb09d1a-bc64-4cfc-950c-94333cc5dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.693411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb09d1a-bc64-4cfc-950c-94333cc5dc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.694066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb09d1a-bc64-4cfc-950c-94333cc5dc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.695710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb09d1a-bc64-4cfc-950c-94333cc5dc99 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.696677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dccee-6237-4b07-85a0-c25ab5f0eab3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.711966 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dccee-6237-4b07-85a0-c25ab5f0eab3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.718226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1139/2238] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:02.719965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb09d1a-bc64-4cfc-950c-94333cc5dc99 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.721636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a128d1-9141-4426-b32f-9696fc5205bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.722409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a128d1-9141-4426-b32f-9696fc5205bf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.724204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a128d1-9141-4426-b32f-9696fc5205bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.724204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a128d1-9141-4426-b32f-9696fc5205bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.724204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a128d1-9141-4426-b32f-9696fc5205bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.727913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a128d1-9141-4426-b32f-9696fc5205bf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.735067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb09d1a-bc64-4cfc-950c-94333cc5dc99 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.743667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e047e16-df6e-48a7-8efd-3c7c462d916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.744606 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e047e16-df6e-48a7-8efd-3c7c462d916e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.745111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e047e16-df6e-48a7-8efd-3c7c462d916e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.745622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e047e16-df6e-48a7-8efd-3c7c462d916e admin admin] PATH_INFO: `/v3/projects/7521bbccb929473da7c47b4dc9f660e8/users/63f5df972c934591931879f6c4bf0ee5/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.747592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1100/2239] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:02.753859 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a128d1-9141-4426-b32f-9696fc5205bf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:02.762558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e047e16-df6e-48a7-8efd-3c7c462d916e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7521bbccb929473da7c47b4dc9f660e8, user_id=63f5df972c934591931879f6c4bf0ee5, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.764441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a128d1-9141-4426-b32f-9696fc5205bf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:02.765800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e047e16-df6e-48a7-8efd-3c7c462d916e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.770126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676e0e-ce1f-4988-9f4d-18c012b38b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:02.770966 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676e0e-ce1f-4988-9f4d-18c012b38b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.771317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676e0e-ce1f-4988-9f4d-18c012b38b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.771666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676e0e-ce1f-4988-9f4d-18c012b38b36 admin admin] PATH_INFO: `/v3/projects/ba137e6f7a994f3a8ceed9c178357b1d/users/001f9ed602154dea83340e65ca2c25f5/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.795220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d676e0e-ce1f-4988-9f4d-18c012b38b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba137e6f7a994f3a8ceed9c178357b1d, user_id=001f9ed602154dea83340e65ca2c25f5, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:02.799751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d676e0e-ce1f-4988-9f4d-18c012b38b36 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:02.913368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1140/2240] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:02 2022] PUT /identity/v3/projects/7521bbccb929473da7c47b4dc9f660e8/users/63f5df972c934591931879f6c4bf0ee5/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:02.927189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1101/2241] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:02 2022] PUT /identity/v3/projects/ba137e6f7a994f3a8ceed9c178357b1d/users/001f9ed602154dea83340e65ca2c25f5/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:02.927683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc90a08-066a-4d70-ba3d-c7fd315b05f8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.927683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc90a08-066a-4d70-ba3d-c7fd315b05f8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.927683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc90a08-066a-4d70-ba3d-c7fd315b05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.937069 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7986f-154f-42b7-bedb-5ae30bfc7a60 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:02.937776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7986f-154f-42b7-bedb-5ae30bfc7a60 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:02.938787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7986f-154f-42b7-bedb-5ae30bfc7a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:02.959967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9cc90a08-066a-4d70-ba3d-c7fd315b05f8 None None] MFA Rules not processed for user `63f5df972c934591931879f6c4bf0ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:02.961212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9cc90a08-066a-4d70-ba3d-c7fd315b05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:03.000151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-03b7986f-154f-42b7-bedb-5ae30bfc7a60 None None] MFA Rules not processed for user `001f9ed602154dea83340e65ca2c25f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:03.006289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-03b7986f-154f-42b7-bedb-5ae30bfc7a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:03.112856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1141/2242] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:03.117243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc90a08-066a-4d70-ba3d-c7fd315b05f8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:03.126885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1102/2243] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:03:03.143981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7986f-154f-42b7-bedb-5ae30bfc7a60 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:03.216754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc90a08-066a-4d70-ba3d-c7fd315b05f8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:03.232472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc6d46-43d1-4840-b07c-ce743686b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:03.234972 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc6d46-43d1-4840-b07c-ce743686b521 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.235549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc6d46-43d1-4840-b07c-ce743686b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.236499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc6d46-43d1-4840-b07c-ce743686b521 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.237200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc6d46-43d1-4840-b07c-ce743686b521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:03.241014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc6d46-43d1-4840-b07c-ce743686b521 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:03.246297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7986f-154f-42b7-bedb-5ae30bfc7a60 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:03.252798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3510e-3f5a-42cc-8b50-4d86dd0574e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:03.253537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3510e-3f5a-42cc-8b50-4d86dd0574e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.253903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3510e-3f5a-42cc-8b50-4d86dd0574e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.254286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3510e-3f5a-42cc-8b50-4d86dd0574e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.255039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3510e-3f5a-42cc-8b50-4d86dd0574e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:03.257149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3510e-3f5a-42cc-8b50-4d86dd0574e8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:03.384186 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1142/2244] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:03 2022] POST /identity/v3/projects => generated 375 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:03.384186 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc6d46-43d1-4840-b07c-ce743686b521 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:03.384497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-07fc6d46-43d1-4840-b07c-ce743686b521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:03.389109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:03.392983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1103/2245] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:03 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:03.393896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3510e-3f5a-42cc-8b50-4d86dd0574e8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:03.461752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc6d46-43d1-4840-b07c-ce743686b521 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:03.462023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3510e-3f5a-42cc-8b50-4d86dd0574e8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:03.466553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:03.467187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.467475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.467756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] PATH_INFO: `/v3/projects/dbea354071cf457fa26a6c7021720cc4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.468718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3474d-d0da-4395-8a64-601dd67881dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:03.468909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbea354071cf457fa26a6c7021720cc4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:03.469313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3474d-d0da-4395-8a64-601dd67881dd admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.469606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3474d-d0da-4395-8a64-601dd67881dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.469886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3474d-d0da-4395-8a64-601dd67881dd admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.470557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3474d-d0da-4395-8a64-601dd67881dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:03.470922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:03.472552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3474d-d0da-4395-8a64-601dd67881dd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:03.584266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1104/2246] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:03 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:03.585187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3474d-d0da-4395-8a64-601dd67881dd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:03.596033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3474d-d0da-4395-8a64-601dd67881dd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:03.600797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77cc3b-bb71-4414-9dcf-d95ec42e7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:03.601403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77cc3b-bb71-4414-9dcf-d95ec42e7cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.601686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77cc3b-bb71-4414-9dcf-d95ec42e7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.601960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77cc3b-bb71-4414-9dcf-d95ec42e7cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.602652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77cc3b-bb71-4414-9dcf-d95ec42e7cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:03.604570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77cc3b-bb71-4414-9dcf-d95ec42e7cc8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:03.628630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbea354071cf457fa26a6c7021720cc4', 'request_id': 'req-0947161e-be7b-4469-b530-d9de8300a7be'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:03.634888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbea354071cf457fa26a6c7021720cc4', 'request_id': 'req-0947161e-be7b-4469-b530-d9de8300a7be'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:03.736064 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbea354071cf457fa26a6c7021720cc4', 'request_id': 'req-0947161e-be7b-4469-b530-d9de8300a7be'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:03.741344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1105/2247] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:03 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:03.742347 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77cc3b-bb71-4414-9dcf-d95ec42e7cc8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:03.751540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] The token cache is being invalidate because project dbea354071cf457fa26a6c7021720cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:03.751834 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:03.752506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:03.753093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77cc3b-bb71-4414-9dcf-d95ec42e7cc8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:03.754025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1143/2248] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:03 2022] DELETE /identity/v3/projects/dbea354071cf457fa26a6c7021720cc4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:03.754858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:03.758994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:03.833207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d2066-2cb5-459a-a12b-7e36766b532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:03.833937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d2066-2cb5-459a-a12b-7e36766b532d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.834342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d2066-2cb5-459a-a12b-7e36766b532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.834660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d2066-2cb5-459a-a12b-7e36766b532d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.835247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d2066-2cb5-459a-a12b-7e36766b532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:03.836860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d2066-2cb5-459a-a12b-7e36766b532d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:03.837387 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947161e-be7b-4469-b530-d9de8300a7be admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:03.842565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376598f-7f71-474b-93b2-3e6ffb79388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:03.843179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376598f-7f71-474b-93b2-3e6ffb79388c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.843441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376598f-7f71-474b-93b2-3e6ffb79388c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.843740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376598f-7f71-474b-93b2-3e6ffb79388c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.844359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376598f-7f71-474b-93b2-3e6ffb79388c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:03.846148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376598f-7f71-474b-93b2-3e6ffb79388c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:03.847085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1106/2249] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:03.848294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7b31e-609d-412f-970c-b345e9f3cbce None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.848721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7b31e-609d-412f-970c-b345e9f3cbce None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.848883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7b31e-609d-412f-970c-b345e9f3cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.861874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1144/2250] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:03.861874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376598f-7f71-474b-93b2-3e6ffb79388c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:03.861874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7376598f-7f71-474b-93b2-3e6ffb79388c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:03.869491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-20b7b31e-609d-412f-970c-b345e9f3cbce None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:03.870701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-20b7b31e-609d-412f-970c-b345e9f3cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:03.874296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376598f-7f71-474b-93b2-3e6ffb79388c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:03.879275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1107/2251] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:03.879786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0821-1539-414a-8ee7-8938b8782313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:03.880067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7b31e-609d-412f-970c-b345e9f3cbce None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:03.880664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0821-1539-414a-8ee7-8938b8782313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.886062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0821-1539-414a-8ee7-8938b8782313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.886062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0821-1539-414a-8ee7-8938b8782313 admin admin] PATH_INFO: `/v3/projects/e5c0b8b182694f269a589b9b9738cbe1/users/93b57aa742ac410ba222d7530e6004bb/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.897422 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7b31e-609d-412f-970c-b345e9f3cbce None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:03.898686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0821-1539-414a-8ee7-8938b8782313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c0b8b182694f269a589b9b9738cbe1, user_id=93b57aa742ac410ba222d7530e6004bb, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:03.901427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0821-1539-414a-8ee7-8938b8782313 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:03.902440 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e44a0-0be9-452a-9bb4-0c768bcd2d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:03.903108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e44a0-0be9-452a-9bb4-0c768bcd2d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:03.903907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e44a0-0be9-452a-9bb4-0c768bcd2d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:03.904183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e44a0-0be9-452a-9bb4-0c768bcd2d27 admin admin] PATH_INFO: `/v3/projects/804ccd55de1a474b9ea57299d73cdeaa/users/bf2083fcd61b494ca91882ee014fcf89/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:03.920743 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e44a0-0be9-452a-9bb4-0c768bcd2d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804ccd55de1a474b9ea57299d73cdeaa, user_id=bf2083fcd61b494ca91882ee014fcf89, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:03.923432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e44a0-0be9-452a-9bb4-0c768bcd2d27 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.013621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1145/2252] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:03 2022] PUT /identity/v3/projects/e5c0b8b182694f269a589b9b9738cbe1/users/93b57aa742ac410ba222d7530e6004bb/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:04.015300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88b062-56ee-442d-9f0f-69014002583f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.015595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88b062-56ee-442d-9f0f-69014002583f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.015976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88b062-56ee-442d-9f0f-69014002583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.047547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1108/2253] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:03 2022] PUT /identity/v3/projects/804ccd55de1a474b9ea57299d73cdeaa/users/bf2083fcd61b494ca91882ee014fcf89/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:04.048408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e44a0-0be9-452a-9bb4-0c768bcd2d27 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.057437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8f88b062-56ee-442d-9f0f-69014002583f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:04.059884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8f88b062-56ee-442d-9f0f-69014002583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:04.149622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e44a0-0be9-452a-9bb4-0c768bcd2d27 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.156345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1146/2254] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:04.157414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88b062-56ee-442d-9f0f-69014002583f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.159051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145332b-f3fe-4432-bd5f-ea8ed0bdddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.160287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145332b-f3fe-4432-bd5f-ea8ed0bdddf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.160645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145332b-f3fe-4432-bd5f-ea8ed0bdddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.160987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145332b-f3fe-4432-bd5f-ea8ed0bdddf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.161721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145332b-f3fe-4432-bd5f-ea8ed0bdddf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.163439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145332b-f3fe-4432-bd5f-ea8ed0bdddf0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.168183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88b062-56ee-442d-9f0f-69014002583f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.174345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09e55c-b65b-4f75-b1d5-6681bbd857b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.174540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1109/2255] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:04.175268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e55c-b65b-4f75-b1d5-6681bbd857b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.175374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145332b-f3fe-4432-bd5f-ea8ed0bdddf0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.175780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e55c-b65b-4f75-b1d5-6681bbd857b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.176183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e55c-b65b-4f75-b1d5-6681bbd857b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.176981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09e55c-b65b-4f75-b1d5-6681bbd857b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.178741 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09e55c-b65b-4f75-b1d5-6681bbd857b0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.186824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145332b-f3fe-4432-bd5f-ea8ed0bdddf0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.189626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1147/2256] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:04.190500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09e55c-b65b-4f75-b1d5-6681bbd857b0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.195925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ab1e2-7fea-4100-97d8-ba6dca15a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.196649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ab1e2-7fea-4100-97d8-ba6dca15a4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.196994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ab1e2-7fea-4100-97d8-ba6dca15a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.197362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ab1e2-7fea-4100-97d8-ba6dca15a4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.198227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ab1e2-7fea-4100-97d8-ba6dca15a4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:04.198605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ab1e2-7fea-4100-97d8-ba6dca15a4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.201109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ab1e2-7fea-4100-97d8-ba6dca15a4d6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.201557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09e55c-b65b-4f75-b1d5-6681bbd857b0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.206570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb58be-fba3-4397-8b78-4700bbcf2f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.207230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb58be-fba3-4397-8b78-4700bbcf2f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.207511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb58be-fba3-4397-8b78-4700bbcf2f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.211790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb58be-fba3-4397-8b78-4700bbcf2f68 admin admin] PATH_INFO: `/v3/projects/e5c0b8b182694f269a589b9b9738cbe1/users/93b57aa742ac410ba222d7530e6004bb/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.211790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb58be-fba3-4397-8b78-4700bbcf2f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c0b8b182694f269a589b9b9738cbe1, user_id=93b57aa742ac410ba222d7530e6004bb, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.219195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1110/2257] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:04.219195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ab1e2-7fea-4100-97d8-ba6dca15a4d6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.219827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb58be-fba3-4397-8b78-4700bbcf2f68 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.233171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1148/2258] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:04 2022] PUT /identity/v3/projects/e5c0b8b182694f269a589b9b9738cbe1/users/93b57aa742ac410ba222d7530e6004bb/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:04.234415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb58be-fba3-4397-8b78-4700bbcf2f68 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.249629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ab1e2-7fea-4100-97d8-ba6dca15a4d6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.316766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:04.319112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5af1ce-3c30-410c-ab6a-be7658499c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.319112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5af1ce-3c30-410c-ab6a-be7658499c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.319580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5af1ce-3c30-410c-ab6a-be7658499c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.319811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5af1ce-3c30-410c-ab6a-be7658499c0c admin admin] PATH_INFO: `/v3/projects/804ccd55de1a474b9ea57299d73cdeaa/users/bf2083fcd61b494ca91882ee014fcf89/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.322486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5af1ce-3c30-410c-ab6a-be7658499c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=804ccd55de1a474b9ea57299d73cdeaa, user_id=bf2083fcd61b494ca91882ee014fcf89, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.325965 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5af1ce-3c30-410c-ab6a-be7658499c0c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.327756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb58be-fba3-4397-8b78-4700bbcf2f68 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.333333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5125ec-1a46-42a8-a25e-975e8aeed184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.334017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5125ec-1a46-42a8-a25e-975e8aeed184 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.334524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5125ec-1a46-42a8-a25e-975e8aeed184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.334828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5125ec-1a46-42a8-a25e-975e8aeed184 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.337482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5125ec-1a46-42a8-a25e-975e8aeed184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.339042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1111/2259] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:04 2022] PUT /identity/v3/projects/804ccd55de1a474b9ea57299d73cdeaa/users/bf2083fcd61b494ca91882ee014fcf89/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:04.339042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309097c-f33d-4aa7-932e-b9afeac06e05 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.339042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309097c-f33d-4aa7-932e-b9afeac06e05 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.339042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309097c-f33d-4aa7-932e-b9afeac06e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.349718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5125ec-1a46-42a8-a25e-975e8aeed184 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.371731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b309097c-f33d-4aa7-932e-b9afeac06e05 None None] MFA Rules not processed for user `93b57aa742ac410ba222d7530e6004bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:04.373101 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b309097c-f33d-4aa7-932e-b9afeac06e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:04.443772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1112/2260] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:04.444842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a228e5a-cec6-44ed-bdfa-40fa62fd6eca None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.445135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a228e5a-cec6-44ed-bdfa-40fa62fd6eca None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.445419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a228e5a-cec6-44ed-bdfa-40fa62fd6eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.457659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1149/2261] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:04 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:04.459093 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeff6aa-8b71-4b65-a0c0-9b97ee169c03 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.459444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeff6aa-8b71-4b65-a0c0-9b97ee169c03 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.459781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeff6aa-8b71-4b65-a0c0-9b97ee169c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.464590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5a228e5a-cec6-44ed-bdfa-40fa62fd6eca None None] MFA Rules not processed for user `2003f3fec37d4320bb511e33212de018`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:04.466500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a228e5a-cec6-44ed-bdfa-40fa62fd6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:04.497779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cbeff6aa-8b71-4b65-a0c0-9b97ee169c03 None None] MFA Rules not processed for user `bf2083fcd61b494ca91882ee014fcf89`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:04.499115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cbeff6aa-8b71-4b65-a0c0-9b97ee169c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:04.532563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1113/2262] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:04.533427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a228e5a-cec6-44ed-bdfa-40fa62fd6eca None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.537473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a228e5a-cec6-44ed-bdfa-40fa62fd6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:04.595501 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1150/2263] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:04.596123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeff6aa-8b71-4b65-a0c0-9b97ee169c03 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.615651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a228e5a-cec6-44ed-bdfa-40fa62fd6eca None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.619600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.620247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.620537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.620813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.623141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:04.682710 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeff6aa-8b71-4b65-a0c0-9b97ee169c03 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.688349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2769d9-c471-4c89-86fa-2b0c1b41e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.688587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.689015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2769d9-c471-4c89-86fa-2b0c1b41e01b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.692646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2769d9-c471-4c89-86fa-2b0c1b41e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.692646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2769d9-c471-4c89-86fa-2b0c1b41e01b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.692843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.692923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2769d9-c471-4c89-86fa-2b0c1b41e01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.692923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2769d9-c471-4c89-86fa-2b0c1b41e01b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.699777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1114/2264] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:04.701052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.702636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:04.720781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53dcc0-339d-428c-b2c0-d87864195d58 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.720781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786e17d-a809-4130-a14e-e936bf2683de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.721145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786e17d-a809-4130-a14e-e936bf2683de service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.721362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786e17d-a809-4130-a14e-e936bf2683de service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.721640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786e17d-a809-4130-a14e-e936bf2683de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.724103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c786e17d-a809-4130-a14e-e936bf2683de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:04.796670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786e17d-a809-4130-a14e-e936bf2683de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.798279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786e17d-a809-4130-a14e-e936bf2683de service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.802959 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1151/2265] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:04 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:04.809263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2769d9-c471-4c89-86fa-2b0c1b41e01b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.812479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1115/2266] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:04.828625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2769d9-c471-4c89-86fa-2b0c1b41e01b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.830919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:04.838720 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6475c-2f98-4efb-bf27-bb82919595fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.839553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6475c-2f98-4efb-bf27-bb82919595fa admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.839982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6475c-2f98-4efb-bf27-bb82919595fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.840401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6475c-2f98-4efb-bf27-bb82919595fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.841437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6475c-2f98-4efb-bf27-bb82919595fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.843320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6475c-2f98-4efb-bf27-bb82919595fa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.855771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1152/2267] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:04.860731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786e17d-a809-4130-a14e-e936bf2683de service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.873157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786e17d-a809-4130-a14e-e936bf2683de service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.880639 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5eaba-eae7-401c-87bd-399087d90d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.881353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5eaba-eae7-401c-87bd-399087d90d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.881644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5eaba-eae7-401c-87bd-399087d90d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.881924 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5eaba-eae7-401c-87bd-399087d90d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.882968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5eaba-eae7-401c-87bd-399087d90d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.884976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5eaba-eae7-401c-87bd-399087d90d4b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:04.905380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1116/2268] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:04.906753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6475c-2f98-4efb-bf27-bb82919595fa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:04.923722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6475c-2f98-4efb-bf27-bb82919595fa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:04.948932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f820bfc-024f-4b66-82e8-d9070ebff0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:04.955920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f820bfc-024f-4b66-82e8-d9070ebff0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:04.955920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f820bfc-024f-4b66-82e8-d9070ebff0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:04.955920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f820bfc-024f-4b66-82e8-d9070ebff0eb admin admin] PATH_INFO: `/v3/projects/48f5b53d06004950a1004fb641f9dc19/users/43915c0288634e7c974bce57e162fe88/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:04.969496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f820bfc-024f-4b66-82e8-d9070ebff0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f5b53d06004950a1004fb641f9dc19, user_id=43915c0288634e7c974bce57e162fe88, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:04.972354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f820bfc-024f-4b66-82e8-d9070ebff0eb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:05.062145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9273a-850f-4f32-bf21-158285cc485b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:05.062684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9273a-850f-4f32-bf21-158285cc485b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:05.062836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9273a-850f-4f32-bf21-158285cc485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:05.065838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1153/2269] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:04 2022] PUT /identity/v3/projects/48f5b53d06004950a1004fb641f9dc19/users/43915c0288634e7c974bce57e162fe88/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:05.092783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-54b9273a-850f-4f32-bf21-158285cc485b None None] MFA Rules not processed for user `43915c0288634e7c974bce57e162fe88`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:05.094030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-54b9273a-850f-4f32-bf21-158285cc485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:05.184518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1117/2270] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:05.194488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f820bfc-024f-4b66-82e8-d9070ebff0eb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:05.265282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f820bfc-024f-4b66-82e8-d9070ebff0eb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:05.269949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9480833-0e3c-4e4c-9c0e-8f4a87fb738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:05.270590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9480833-0e3c-4e4c-9c0e-8f4a87fb738b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:05.270862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9480833-0e3c-4e4c-9c0e-8f4a87fb738b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:05.274473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9480833-0e3c-4e4c-9c0e-8f4a87fb738b admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:05.275285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9480833-0e3c-4e4c-9c0e-8f4a87fb738b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:05.277266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9480833-0e3c-4e4c-9c0e-8f4a87fb738b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:05.298944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:05.385557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1154/2271] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:05 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:05.391480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9273a-850f-4f32-bf21-158285cc485b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:05.407774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9273a-850f-4f32-bf21-158285cc485b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:05.511285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa508f6-019e-49e9-accf-aa58556cd717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:05.512197 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa508f6-019e-49e9-accf-aa58556cd717 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:05.512500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa508f6-019e-49e9-accf-aa58556cd717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:05.512833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa508f6-019e-49e9-accf-aa58556cd717 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:05.513561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa508f6-019e-49e9-accf-aa58556cd717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:05.517283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa508f6-019e-49e9-accf-aa58556cd717 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:05.647749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1118/2272] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:05 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:05.658411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9480833-0e3c-4e4c-9c0e-8f4a87fb738b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:05.671170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9480833-0e3c-4e4c-9c0e-8f4a87fb738b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:05.678155 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a336bb-40ce-4833-b2cd-07403e47a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:05.678783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a336bb-40ce-4833-b2cd-07403e47a507 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:05.679065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a336bb-40ce-4833-b2cd-07403e47a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:05.679340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a336bb-40ce-4833-b2cd-07403e47a507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:05.680505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a336bb-40ce-4833-b2cd-07403e47a507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:05.682178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a336bb-40ce-4833-b2cd-07403e47a507 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:05.697502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1155/2273] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:05.698703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa508f6-019e-49e9-accf-aa58556cd717 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:05.709488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa508f6-019e-49e9-accf-aa58556cd717 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:05.714693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba02f4c-1cae-42e8-9411-4148208228cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:05.715496 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba02f4c-1cae-42e8-9411-4148208228cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:05.715810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba02f4c-1cae-42e8-9411-4148208228cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:05.716237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba02f4c-1cae-42e8-9411-4148208228cb admin admin] PATH_INFO: `/v3/projects/667a6ea41725424fb2859ee6dc67bd4c/users/ff38ac28f40f40adb8c1ff32b6a91d0e/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:05.740302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba02f4c-1cae-42e8-9411-4148208228cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=667a6ea41725424fb2859ee6dc67bd4c, user_id=ff38ac28f40f40adb8c1ff32b6a91d0e, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:05.745825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba02f4c-1cae-42e8-9411-4148208228cb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:05.846187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1119/2274] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:05 2022] PUT /identity/v3/projects/667a6ea41725424fb2859ee6dc67bd4c/users/ff38ac28f40f40adb8c1ff32b6a91d0e/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:05.846467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a336bb-40ce-4833-b2cd-07403e47a507 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:05.874407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a336bb-40ce-4833-b2cd-07403e47a507 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:05.962748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:05.987997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabae1ce-56f5-469e-b5e4-df609e391e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:05.988615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae1ce-56f5-469e-b5e4-df609e391e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:05.988899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae1ce-56f5-469e-b5e4-df609e391e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:05.994516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabae1ce-56f5-469e-b5e4-df609e391e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:05.994516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae1ce-56f5-469e-b5e4-df609e391e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:05.994516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabae1ce-56f5-469e-b5e4-df609e391e23 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:06.001542 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1156/2275] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:06.005650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba02f4c-1cae-42e8-9411-4148208228cb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:06.016013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba02f4c-1cae-42e8-9411-4148208228cb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:06.021136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57432c1-2c41-4591-9267-9a79f968ccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:06.021803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57432c1-2c41-4591-9267-9a79f968ccd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:06.022102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57432c1-2c41-4591-9267-9a79f968ccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:06.022393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57432c1-2c41-4591-9267-9a79f968ccd5 admin admin] PATH_INFO: `/v3/projects/667a6ea41725424fb2859ee6dc67bd4c/users/ff38ac28f40f40adb8c1ff32b6a91d0e/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:06.024336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57432c1-2c41-4591-9267-9a79f968ccd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667a6ea41725424fb2859ee6dc67bd4c, user_id=ff38ac28f40f40adb8c1ff32b6a91d0e, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:06.027108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57432c1-2c41-4591-9267-9a79f968ccd5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:06.038422 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1120/2276] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:06 2022] PUT /identity/v3/projects/667a6ea41725424fb2859ee6dc67bd4c/users/ff38ac28f40f40adb8c1ff32b6a91d0e/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:06.054318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91ba98-d7d2-4582-9c8a-89c6bdf66f20 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:06.054318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91ba98-d7d2-4582-9c8a-89c6bdf66f20 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:06.054318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91ba98-d7d2-4582-9c8a-89c6bdf66f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:06.085322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ba91ba98-d7d2-4582-9c8a-89c6bdf66f20 None None] MFA Rules not processed for user `ff38ac28f40f40adb8c1ff32b6a91d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:06.087333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ba91ba98-d7d2-4582-9c8a-89c6bdf66f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:06.158765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1157/2277] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:06.170980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57432c1-2c41-4591-9267-9a79f968ccd5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:06.233963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57432c1-2c41-4591-9267-9a79f968ccd5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:06.237634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc19586-15a9-48ec-af08-9fd8da1961bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:06.238277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc19586-15a9-48ec-af08-9fd8da1961bd service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:06.238929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc19586-15a9-48ec-af08-9fd8da1961bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:06.238929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc19586-15a9-48ec-af08-9fd8da1961bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:06.302522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc19586-15a9-48ec-af08-9fd8da1961bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:06.305251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc19586-15a9-48ec-af08-9fd8da1961bd service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:06.318927 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1121/2278] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:06.584863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:07.083828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:07.125758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:07.138379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91ba98-d7d2-4582-9c8a-89c6bdf66f20 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:07.151383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91ba98-d7d2-4582-9c8a-89c6bdf66f20 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:07.161105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01370dc0-d6a9-40d6-a254-08961aed9d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:07.161105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01370dc0-d6a9-40d6-a254-08961aed9d4c service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:07.161105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01370dc0-d6a9-40d6-a254-08961aed9d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:07.161105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01370dc0-d6a9-40d6-a254-08961aed9d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:07.161605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-01370dc0-d6a9-40d6-a254-08961aed9d4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:07.165619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc19586-15a9-48ec-af08-9fd8da1961bd service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:07.175377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc19586-15a9-48ec-af08-9fd8da1961bd service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:07.181769 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1e173-d532-4c3f-99a7-d2fbec370399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:07.182669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1e173-d532-4c3f-99a7-d2fbec370399 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:07.183155 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1e173-d532-4c3f-99a7-d2fbec370399 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:07.183651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1e173-d532-4c3f-99a7-d2fbec370399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:07.186301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-87a1e173-d532-4c3f-99a7-d2fbec370399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:07.259686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01370dc0-d6a9-40d6-a254-08961aed9d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:07.261305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01370dc0-d6a9-40d6-a254-08961aed9d4c service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:07.280156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1158/2279] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:07.281809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1e173-d532-4c3f-99a7-d2fbec370399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:07.283689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1e173-d532-4c3f-99a7-d2fbec370399 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:07.294817 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1122/2280] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:03:08.121460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:08.583901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:09.126906 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01370dc0-d6a9-40d6-a254-08961aed9d4c service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:09.136031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01370dc0-d6a9-40d6-a254-08961aed9d4c service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:09.140329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19770f51-687c-46cf-94d9-ecf2a0c77d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:09.141001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19770f51-687c-46cf-94d9-ecf2a0c77d80 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:09.141283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19770f51-687c-46cf-94d9-ecf2a0c77d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:09.141554 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19770f51-687c-46cf-94d9-ecf2a0c77d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:09.161594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:09.214004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19770f51-687c-46cf-94d9-ecf2a0c77d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:09.215741 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19770f51-687c-46cf-94d9-ecf2a0c77d80 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:09.222044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1e173-d532-4c3f-99a7-d2fbec370399 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:09.227713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1159/2281] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:09.235094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1e173-d532-4c3f-99a7-d2fbec370399 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:09.240356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df768406-5d7d-4a1b-8745-e56ec5103349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:09.240972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768406-5d7d-4a1b-8745-e56ec5103349 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:09.243380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768406-5d7d-4a1b-8745-e56ec5103349 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:09.243380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df768406-5d7d-4a1b-8745-e56ec5103349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:09.308365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df768406-5d7d-4a1b-8745-e56ec5103349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:09.309757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df768406-5d7d-4a1b-8745-e56ec5103349 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:09.320296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1123/2282] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:03:10.476163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:10.504326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19770f51-687c-46cf-94d9-ecf2a0c77d80 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:10.573680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19770f51-687c-46cf-94d9-ecf2a0c77d80 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:10.578968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:10.579694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:10.579976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:10.580256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] PATH_INFO: `/v3/users/43915c0288634e7c974bce57e162fe88` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:10.581367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43915c0288634e7c974bce57e162fe88)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:10.583367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:10.660661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:10.775197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43915c0288634e7c974bce57e162fe88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:10.775878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43915c0288634e7c974bce57e162fe88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:10.784426 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43915c0288634e7c974bce57e162fe88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:10.836029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43915c0288634e7c974bce57e162fe88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:10.836670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43915c0288634e7c974bce57e162fe88'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:10.854820 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1160/2283] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:10 2022] DELETE /identity/v3/users/43915c0288634e7c974bce57e162fe88 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:10.859962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1892d7e-93dc-414b-a8b5-9966efbe1329 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:10.864490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1892d7e-93dc-414b-a8b5-9966efbe1329 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:10.864490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1892d7e-93dc-414b-a8b5-9966efbe1329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:10.879852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b1892d7e-93dc-414b-a8b5-9966efbe1329 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:10.881066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b1892d7e-93dc-414b-a8b5-9966efbe1329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:10.953038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1124/2284] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:10.970510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:10.971928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:11.052988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528bef-68be-40da-8c1d-0975e48805b1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:11.057360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77995c8-e3e3-4ca1-96e2-eab1efdd346b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:11.060336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77995c8-e3e3-4ca1-96e2-eab1efdd346b service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:11.060336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77995c8-e3e3-4ca1-96e2-eab1efdd346b service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:11.060336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77995c8-e3e3-4ca1-96e2-eab1efdd346b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:11.071266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77995c8-e3e3-4ca1-96e2-eab1efdd346b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:11.072838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77995c8-e3e3-4ca1-96e2-eab1efdd346b service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:11.111427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1161/2285] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:11.921258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:11.986022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1892d7e-93dc-414b-a8b5-9966efbe1329 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:11.987627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b1892d7e-93dc-414b-a8b5-9966efbe1329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:12.001193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1892d7e-93dc-414b-a8b5-9966efbe1329 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:12.023144 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:12.024016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:12.024285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:12.024564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] PATH_INFO: `/v3/projects/48f5b53d06004950a1004fb641f9dc19` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:12.025970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f5b53d06004950a1004fb641f9dc19)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:12.028694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:12.135011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f5b53d06004950a1004fb641f9dc19', 'request_id': 'req-f49fdea1-569e-4b22-95c4-68db93846b18'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.150041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f5b53d06004950a1004fb641f9dc19', 'request_id': 'req-f49fdea1-569e-4b22-95c4-68db93846b18'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.156856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f5b53d06004950a1004fb641f9dc19', 'request_id': 'req-f49fdea1-569e-4b22-95c4-68db93846b18'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.267340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] The token cache is being invalidate because project 48f5b53d06004950a1004fb641f9dc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:12.267340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.267999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.270434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1125/2286] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:11 2022] DELETE /identity/v3/projects/48f5b53d06004950a1004fb641f9dc19 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:12.274827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77995c8-e3e3-4ca1-96e2-eab1efdd346b service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:12.288441 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77995c8-e3e3-4ca1-96e2-eab1efdd346b service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:12.364459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:12.365219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:12.365500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:12.365770 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] PATH_INFO: `/v3/users/ff38ac28f40f40adb8c1ff32b6a91d0e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:12.366941 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff38ac28f40f40adb8c1ff32b6a91d0e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:12.368863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:12.519412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:12.583285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff38ac28f40f40adb8c1ff32b6a91d0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.583945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff38ac28f40f40adb8c1ff32b6a91d0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.590218 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:12.600066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff38ac28f40f40adb8c1ff32b6a91d0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.698330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff38ac28f40f40adb8c1ff32b6a91d0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.699221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5e71e357-7d6e-43c4-afee-982d75a38357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff38ac28f40f40adb8c1ff32b6a91d0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:12.718707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1162/2287] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:12 2022] DELETE /identity/v3/users/ff38ac28f40f40adb8c1ff32b6a91d0e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:13.117979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:13.120058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:13.140479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fdea1-569e-4b22-95c4-68db93846b18 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:13.204703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:13.205359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:13.205664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:13.205962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] PATH_INFO: `/v3/projects/667a6ea41725424fb2859ee6dc67bd4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:13.207156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=667a6ea41725424fb2859ee6dc67bd4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:13.209169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:13.325632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667a6ea41725424fb2859ee6dc67bd4c', 'request_id': 'req-daf592b3-6645-4a6b-8b02-48f6efd60b7f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:13.337789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667a6ea41725424fb2859ee6dc67bd4c', 'request_id': 'req-daf592b3-6645-4a6b-8b02-48f6efd60b7f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:13.344584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667a6ea41725424fb2859ee6dc67bd4c', 'request_id': 'req-daf592b3-6645-4a6b-8b02-48f6efd60b7f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:13.469744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] The token cache is being invalidate because project 667a6ea41725424fb2859ee6dc67bd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:13.469977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:13.470650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-daf592b3-6645-4a6b-8b02-48f6efd60b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:13.472199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1126/2288] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:13 2022] DELETE /identity/v3/projects/667a6ea41725424fb2859ee6dc67bd4c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:13.477184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6410-69cd-42e9-9d30-dc121ea0e4b7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:13.477674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6410-69cd-42e9-9d30-dc121ea0e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:13.477780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d6410-69cd-42e9-9d30-dc121ea0e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:13.498245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ee4d6410-69cd-42e9-9d30-dc121ea0e4b7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:13.499486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ee4d6410-69cd-42e9-9d30-dc121ea0e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:13.560443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1163/2289] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:13.568356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab0b03-d6ab-491d-a5f7-1c354f4d5483 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:13.568649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab0b03-d6ab-491d-a5f7-1c354f4d5483 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:13.568927 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab0b03-d6ab-491d-a5f7-1c354f4d5483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:13.590841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d3ab0b03-d6ab-491d-a5f7-1c354f4d5483 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:13.593589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d3ab0b03-d6ab-491d-a5f7-1c354f4d5483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:13.600344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1127/2290] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:13.604539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d6410-69cd-42e9-9d30-dc121ea0e4b7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:13.614669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d6410-69cd-42e9-9d30-dc121ea0e4b7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:13.619369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2b422-1680-4cb2-8a8f-d60bedee90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:13.626063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2b422-1680-4cb2-8a8f-d60bedee90a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:13.626063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2b422-1680-4cb2-8a8f-d60bedee90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:13.626063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2b422-1680-4cb2-8a8f-d60bedee90a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:13.626063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2b422-1680-4cb2-8a8f-d60bedee90a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:13.626063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2b422-1680-4cb2-8a8f-d60bedee90a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:13.626063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2b422-1680-4cb2-8a8f-d60bedee90a4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:13.634292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1164/2291] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:13.638659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab0b03-d6ab-491d-a5f7-1c354f4d5483 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:13.649696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab0b03-d6ab-491d-a5f7-1c354f4d5483 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:13.655866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75fb26-8218-434e-8a85-80ec5c6d3141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:13.656517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75fb26-8218-434e-8a85-80ec5c6d3141 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:13.656811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75fb26-8218-434e-8a85-80ec5c6d3141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:13.657099 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75fb26-8218-434e-8a85-80ec5c6d3141 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:13.657747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75fb26-8218-434e-8a85-80ec5c6d3141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:13.659822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75fb26-8218-434e-8a85-80ec5c6d3141 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:13.740172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1128/2292] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:13 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:13.744409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2b422-1680-4cb2-8a8f-d60bedee90a4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:13.755897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2b422-1680-4cb2-8a8f-d60bedee90a4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:13.818611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a924b7-de88-4bda-9d6a-47adae4ef50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:13.819227 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a924b7-de88-4bda-9d6a-47adae4ef50f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:13.819509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a924b7-de88-4bda-9d6a-47adae4ef50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:13.819784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a924b7-de88-4bda-9d6a-47adae4ef50f admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:13.820452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a924b7-de88-4bda-9d6a-47adae4ef50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:13.822394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a924b7-de88-4bda-9d6a-47adae4ef50f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:13.915615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:13.920626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1165/2293] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:13 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:03:13.926952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75fb26-8218-434e-8a85-80ec5c6d3141 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:13.950567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75fb26-8218-434e-8a85-80ec5c6d3141 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:13.969336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:13.970337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211328d-8224-43d1-92f4-1d052d6c5b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:13.971169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211328d-8224-43d1-92f4-1d052d6c5b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:13.971598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211328d-8224-43d1-92f4-1d052d6c5b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:13.972129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211328d-8224-43d1-92f4-1d052d6c5b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:13.973020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211328d-8224-43d1-92f4-1d052d6c5b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:13.974885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211328d-8224-43d1-92f4-1d052d6c5b2a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:13.988068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1129/2294] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:13.993180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a924b7-de88-4bda-9d6a-47adae4ef50f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:14.017952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a924b7-de88-4bda-9d6a-47adae4ef50f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:14.019757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755947d-0947-4068-b811-02818ecb4fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:14.020515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755947d-0947-4068-b811-02818ecb4fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.020873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755947d-0947-4068-b811-02818ecb4fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.021326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755947d-0947-4068-b811-02818ecb4fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.022126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755947d-0947-4068-b811-02818ecb4fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:14.024590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755947d-0947-4068-b811-02818ecb4fbf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:14.044890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1166/2295] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:14.048728 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755947d-0947-4068-b811-02818ecb4fbf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:14.048890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211328d-8224-43d1-92f4-1d052d6c5b2a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:14.050709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f211328d-8224-43d1-92f4-1d052d6c5b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:14.061984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755947d-0947-4068-b811-02818ecb4fbf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:14.067735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73515a4-46ec-45cc-90f6-7840f7981f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:14.068544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73515a4-46ec-45cc-90f6-7840f7981f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.068826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73515a4-46ec-45cc-90f6-7840f7981f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.069233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73515a4-46ec-45cc-90f6-7840f7981f94 admin admin] PATH_INFO: `/v3/projects/75cfbc3375164e82875c7b7078de5a66/users/ea0a3d21442640c89553e2e1fdb35b0e/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.073835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211328d-8224-43d1-92f4-1d052d6c5b2a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:14.081160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:14.083312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.083808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.084241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] PATH_INFO: `/v3/users/1b5312aefc1b44f8bcbd3c64499b23d9` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.085916 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5312aefc1b44f8bcbd3c64499b23d9)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:14.089300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:14.120197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73515a4-46ec-45cc-90f6-7840f7981f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cfbc3375164e82875c7b7078de5a66, user_id=ea0a3d21442640c89553e2e1fdb35b0e, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:14.126512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73515a4-46ec-45cc-90f6-7840f7981f94 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:14.252090 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1167/2296] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:14 2022] PUT /identity/v3/projects/75cfbc3375164e82875c7b7078de5a66/users/ea0a3d21442640c89553e2e1fdb35b0e/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:14.267004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73515a4-46ec-45cc-90f6-7840f7981f94 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:14.267782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b73515a4-46ec-45cc-90f6-7840f7981f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:14.341321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73515a4-46ec-45cc-90f6-7840f7981f94 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:14.347419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:14.348119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.348405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.348682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] PATH_INFO: `/v3/users/874113b02d024e3da45316c6480f3d2a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.353107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=874113b02d024e3da45316c6480f3d2a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:14.358022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:14.363503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5312aefc1b44f8bcbd3c64499b23d9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.364430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5312aefc1b44f8bcbd3c64499b23d9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.383674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5312aefc1b44f8bcbd3c64499b23d9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.384439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5312aefc1b44f8bcbd3c64499b23d9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.404033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8a5aab18-e1f1-4a99-bb57-33e4827f4ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5312aefc1b44f8bcbd3c64499b23d9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.503448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1130/2297] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:14 2022] DELETE /identity/v3/users/1b5312aefc1b44f8bcbd3c64499b23d9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:14.505062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b37f-f7ff-4cb7-ae89-41cdc99bac2a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.505366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b37f-f7ff-4cb7-ae89-41cdc99bac2a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.506155 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b37f-f7ff-4cb7-ae89-41cdc99bac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.544560 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7406b37f-f7ff-4cb7-ae89-41cdc99bac2a None None] MFA Rules not processed for user `ea0a3d21442640c89553e2e1fdb35b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:14.545815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7406b37f-f7ff-4cb7-ae89-41cdc99bac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:14.568123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '874113b02d024e3da45316c6480f3d2a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.569453 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '874113b02d024e3da45316c6480f3d2a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.582067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '874113b02d024e3da45316c6480f3d2a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.628892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1131/2298] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:14.631116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3820f-b49e-41bd-8da4-c6f9a6a924ca None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.631419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3820f-b49e-41bd-8da4-c6f9a6a924ca None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.631704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3820f-b49e-41bd-8da4-c6f9a6a924ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.650753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-13b3820f-b49e-41bd-8da4-c6f9a6a924ca None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:14.652050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-13b3820f-b49e-41bd-8da4-c6f9a6a924ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:14.652183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '874113b02d024e3da45316c6480f3d2a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.652904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '874113b02d024e3da45316c6480f3d2a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:14.677952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1168/2299] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:14 2022] DELETE /identity/v3/users/874113b02d024e3da45316c6480f3d2a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:14.677952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:14.678126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:14.746102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1132/2300] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:14.751132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eaa56-409d-4a45-b079-87d5adb48e16 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.751425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eaa56-409d-4a45-b079-87d5adb48e16 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.751818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eaa56-409d-4a45-b079-87d5adb48e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.761964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:14.773296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e154741-4b48-4425-be17-8bb478d19b1c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:14.773890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0d6eaa56-409d-4a45-b079-87d5adb48e16 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:14.775546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0d6eaa56-409d-4a45-b079-87d5adb48e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:14.779863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1366-90e4-491a-a15d-ac52eb820341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:14.780487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1366-90e4-491a-a15d-ac52eb820341 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.780827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1366-90e4-491a-a15d-ac52eb820341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.781171 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df1366-90e4-491a-a15d-ac52eb820341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.781893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df1366-90e4-491a-a15d-ac52eb820341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:14.784106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df1366-90e4-491a-a15d-ac52eb820341 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:14.784843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1133/2301] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:14.785692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6eaa56-409d-4a45-b079-87d5adb48e16 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:14.787020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0d6eaa56-409d-4a45-b079-87d5adb48e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:14.851958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6eaa56-409d-4a45-b079-87d5adb48e16 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:14.856628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5095c7-dec6-4c64-ae27-037120aca13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:14.857237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5095c7-dec6-4c64-ae27-037120aca13d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.857522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5095c7-dec6-4c64-ae27-037120aca13d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.857799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5095c7-dec6-4c64-ae27-037120aca13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.866699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5095c7-dec6-4c64-ae27-037120aca13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:14.868210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5095c7-dec6-4c64-ae27-037120aca13d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:14.878565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1134/2302] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:14.879530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5095c7-dec6-4c64-ae27-037120aca13d service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:14.887749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5095c7-dec6-4c64-ae27-037120aca13d service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:14.891852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b725bb-c656-4f32-a9dc-6daf27e3a047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:14.892477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b725bb-c656-4f32-a9dc-6daf27e3a047 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:14.892718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b725bb-c656-4f32-a9dc-6daf27e3a047 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:14.892994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b725bb-c656-4f32-a9dc-6daf27e3a047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:14.903484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b725bb-c656-4f32-a9dc-6daf27e3a047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:14.904972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b725bb-c656-4f32-a9dc-6daf27e3a047 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:14.916471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1135/2303] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:14.959700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1169/2304] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:14 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:14.960882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b725bb-c656-4f32-a9dc-6daf27e3a047 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:14.973745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b725bb-c656-4f32-a9dc-6daf27e3a047 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:15.057190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60d79-2155-46d3-be88-c9038b16b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:15.058885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60d79-2155-46d3-be88-c9038b16b372 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:15.062227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60d79-2155-46d3-be88-c9038b16b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:15.062713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60d79-2155-46d3-be88-c9038b16b372 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:15.063473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60d79-2155-46d3-be88-c9038b16b372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:15.065565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60d79-2155-46d3-be88-c9038b16b372 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:15.139332 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1136/2305] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:14 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:03:15.140404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1366-90e4-491a-a15d-ac52eb820341 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:15.151981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df1366-90e4-491a-a15d-ac52eb820341 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:15.157990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1607a7-e730-46a7-9c76-e627cd4bfc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:15.158637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1607a7-e730-46a7-9c76-e627cd4bfc9f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:15.159488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1607a7-e730-46a7-9c76-e627cd4bfc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:15.159791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1607a7-e730-46a7-9c76-e627cd4bfc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:15.160539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1607a7-e730-46a7-9c76-e627cd4bfc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:15.162061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1607a7-e730-46a7-9c76-e627cd4bfc9f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:15.175873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1170/2306] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:15.180230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60d79-2155-46d3-be88-c9038b16b372 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:15.191999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60d79-2155-46d3-be88-c9038b16b372 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:15.196812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8f485-ec18-4e84-aeac-1cac0167cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:15.197427 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f485-ec18-4e84-aeac-1cac0167cf84 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:15.197708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f485-ec18-4e84-aeac-1cac0167cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:15.197985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f485-ec18-4e84-aeac-1cac0167cf84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:15.198844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8f485-ec18-4e84-aeac-1cac0167cf84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:15.201178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8f485-ec18-4e84-aeac-1cac0167cf84 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:15.217171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1137/2307] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:03:15.221213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1607a7-e730-46a7-9c76-e627cd4bfc9f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:15.233754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1607a7-e730-46a7-9c76-e627cd4bfc9f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:15.242743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce936-d7a9-4307-90bf-f3b61d2cdaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:15.242743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce936-d7a9-4307-90bf-f3b61d2cdaf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:15.242743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce936-d7a9-4307-90bf-f3b61d2cdaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:15.242743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce936-d7a9-4307-90bf-f3b61d2cdaf6 admin admin] PATH_INFO: `/v3/projects/e5334a2a285f4108abcc21ee59b31949/users/4f3c1ddb2ad449c5a256decb06b840c2/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:15.271858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce936-d7a9-4307-90bf-f3b61d2cdaf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5334a2a285f4108abcc21ee59b31949, user_id=4f3c1ddb2ad449c5a256decb06b840c2, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:15.271858 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce936-d7a9-4307-90bf-f3b61d2cdaf6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:15.322126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:15.424601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1171/2308] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:15 2022] PUT /identity/v3/projects/e5334a2a285f4108abcc21ee59b31949/users/4f3c1ddb2ad449c5a256decb06b840c2/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:15.435457 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9065-f6c3-4511-bf24-2fb8c7cbb7e1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:15.435973 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9065-f6c3-4511-bf24-2fb8c7cbb7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:15.436127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9065-f6c3-4511-bf24-2fb8c7cbb7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:15.465772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1f6e9065-f6c3-4511-bf24-2fb8c7cbb7e1 None None] MFA Rules not processed for user `4f3c1ddb2ad449c5a256decb06b840c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:15.467055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1f6e9065-f6c3-4511-bf24-2fb8c7cbb7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:15.505705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce936-d7a9-4307-90bf-f3b61d2cdaf6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:15.507808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-188ce936-d7a9-4307-90bf-f3b61d2cdaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:15.537513 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1138/2309] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:15.541729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9065-f6c3-4511-bf24-2fb8c7cbb7e1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:15.590797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce936-d7a9-4307-90bf-f3b61d2cdaf6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:15.596945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:15.597782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:15.598229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:15.598579 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] PATH_INFO: `/v3/projects/b6e524d857f04c9ca88f9cd87ef70c83` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:15.600094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e524d857f04c9ca88f9cd87ef70c83)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:15.603198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:15.621253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9065-f6c3-4511-bf24-2fb8c7cbb7e1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:15.630341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111721e0-5da8-4c79-8aaa-085bbc65bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:15.630341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111721e0-5da8-4c79-8aaa-085bbc65bf46 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:15.630341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111721e0-5da8-4c79-8aaa-085bbc65bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:15.630341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111721e0-5da8-4c79-8aaa-085bbc65bf46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:15.630868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111721e0-5da8-4c79-8aaa-085bbc65bf46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:15.630868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111721e0-5da8-4c79-8aaa-085bbc65bf46 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:15.729763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1139/2310] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:15 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:15.730494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111721e0-5da8-4c79-8aaa-085bbc65bf46 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:15.732145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-111721e0-5da8-4c79-8aaa-085bbc65bf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:15.745631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e524d857f04c9ca88f9cd87ef70c83', 'request_id': 'req-6ff64d2b-31de-416f-8b0b-07720917a2d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:15.753879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e524d857f04c9ca88f9cd87ef70c83', 'request_id': 'req-6ff64d2b-31de-416f-8b0b-07720917a2d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:15.798869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111721e0-5da8-4c79-8aaa-085bbc65bf46 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:15.803567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:15.804453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:15.804730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:15.805003 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] PATH_INFO: `/v3/projects/ed97e0f129f14e9ebbacbe2cec8e60c2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:15.806149 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed97e0f129f14e9ebbacbe2cec8e60c2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:15.808052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:15.829245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e524d857f04c9ca88f9cd87ef70c83', 'request_id': 'req-6ff64d2b-31de-416f-8b0b-07720917a2d3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:15.846883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] The token cache is being invalidate because project b6e524d857f04c9ca88f9cd87ef70c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:15.850141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:15.850141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:15.850141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1172/2311] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:15 2022] DELETE /identity/v3/projects/b6e524d857f04c9ca88f9cd87ef70c83 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:15.850141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:15.851394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:15.915066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64d2b-31de-416f-8b0b-07720917a2d3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:15.922031 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed97e0f129f14e9ebbacbe2cec8e60c2', 'request_id': 'req-4848a604-2028-4130-89de-add2c7273530'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:15.928475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed97e0f129f14e9ebbacbe2cec8e60c2', 'request_id': 'req-4848a604-2028-4130-89de-add2c7273530'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:15.935608 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed97e0f129f14e9ebbacbe2cec8e60c2', 'request_id': 'req-4848a604-2028-4130-89de-add2c7273530'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:15.983245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f4921-90d9-4ce6-864c-a5634c9f2ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:15.983867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4921-90d9-4ce6-864c-a5634c9f2ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:15.984137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4921-90d9-4ce6-864c-a5634c9f2ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:15.984413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4921-90d9-4ce6-864c-a5634c9f2ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:15.985042 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f4921-90d9-4ce6-864c-a5634c9f2ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:15.987003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f4921-90d9-4ce6-864c-a5634c9f2ac0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:16.000678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] The token cache is being invalidate because project ed97e0f129f14e9ebbacbe2cec8e60c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:16.003943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.003943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.003943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1140/2312] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:15 2022] DELETE /identity/v3/projects/ed97e0f129f14e9ebbacbe2cec8e60c2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:16.003943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:16.005247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:16.018039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848a604-2028-4130-89de-add2c7273530 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:16.023086 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:16.023786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:16.023990 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:16.024270 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] PATH_INFO: `/v3/users/001f9ed602154dea83340e65ca2c25f5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:16.025424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=001f9ed602154dea83340e65ca2c25f5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:16.027560 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:16.119261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1173/2313] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:15 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:16.120366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f4921-90d9-4ce6-864c-a5634c9f2ac0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:16.125752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b96f4921-90d9-4ce6-864c-a5634c9f2ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:16.139804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f4921-90d9-4ce6-864c-a5634c9f2ac0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:16.146753 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:16.147538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:16.147982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:16.148396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] PATH_INFO: `/v3/users/63f5df972c934591931879f6c4bf0ee5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:16.150344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f5df972c934591931879f6c4bf0ee5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:16.153301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:16.263596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001f9ed602154dea83340e65ca2c25f5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.264396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001f9ed602154dea83340e65ca2c25f5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.272205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001f9ed602154dea83340e65ca2c25f5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.272979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001f9ed602154dea83340e65ca2c25f5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.286740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001f9ed602154dea83340e65ca2c25f5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.383277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1141/2314] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:16 2022] DELETE /identity/v3/users/001f9ed602154dea83340e65ca2c25f5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:16.384270 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:16.387509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:16.401188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f5df972c934591931879f6c4bf0ee5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.402518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f5df972c934591931879f6c4bf0ee5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.420640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f5df972c934591931879f6c4bf0ee5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.485387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30657999-263b-431c-bf40-9ccb1e1926bb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:16.490382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b84a2f-9a68-47a1-8dcd-c0e6f7054a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:16.491251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b84a2f-9a68-47a1-8dcd-c0e6f7054a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:16.491632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b84a2f-9a68-47a1-8dcd-c0e6f7054a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:16.491973 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b84a2f-9a68-47a1-8dcd-c0e6f7054a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:16.492713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b84a2f-9a68-47a1-8dcd-c0e6f7054a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:16.494685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b84a2f-9a68-47a1-8dcd-c0e6f7054a86 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:16.508573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1142/2315] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:16.510322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b84a2f-9a68-47a1-8dcd-c0e6f7054a86 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:16.515326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f5df972c934591931879f6c4bf0ee5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.516356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f5df972c934591931879f6c4bf0ee5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:16.524600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b84a2f-9a68-47a1-8dcd-c0e6f7054a86 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:16.530498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eec202-ed80-4f3d-b83a-ddc9706c8901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:16.531175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eec202-ed80-4f3d-b83a-ddc9706c8901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:16.531462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eec202-ed80-4f3d-b83a-ddc9706c8901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:16.531737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eec202-ed80-4f3d-b83a-ddc9706c8901 admin admin] PATH_INFO: `/v3/projects/a0931db64dbf4878a46d96581c02dfb8/users/fecf2578448947aa8fa684a21375a7b9/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:16.542623 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1174/2316] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:16 2022] DELETE /identity/v3/users/63f5df972c934591931879f6c4bf0ee5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:16.547695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eec202-ed80-4f3d-b83a-ddc9706c8901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0931db64dbf4878a46d96581c02dfb8, user_id=fecf2578448947aa8fa684a21375a7b9, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:16.550470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eec202-ed80-4f3d-b83a-ddc9706c8901 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:16.665526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1143/2317] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:16 2022] PUT /identity/v3/projects/a0931db64dbf4878a46d96581c02dfb8/users/fecf2578448947aa8fa684a21375a7b9/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:16.670290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:16.672357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:16.750256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e54cf-152d-4145-b6c4-89b72d87f948 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:16.812613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77a6c4-e532-45a6-9132-c5653ae414cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:16.813238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a6c4-e532-45a6-9132-c5653ae414cd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:16.813525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a6c4-e532-45a6-9132-c5653ae414cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:16.813801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a6c4-e532-45a6-9132-c5653ae414cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:16.814490 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77a6c4-e532-45a6-9132-c5653ae414cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:16.816135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77a6c4-e532-45a6-9132-c5653ae414cd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:16.826996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1175/2318] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:03:16.831358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eec202-ed80-4f3d-b83a-ddc9706c8901 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:16.843124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eec202-ed80-4f3d-b83a-ddc9706c8901 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:16.847963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a689b7e-5e40-42f1-b3f3-f9cbc7396140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:16.848618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a689b7e-5e40-42f1-b3f3-f9cbc7396140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:16.848896 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a689b7e-5e40-42f1-b3f3-f9cbc7396140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:16.849166 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a689b7e-5e40-42f1-b3f3-f9cbc7396140 admin admin] PATH_INFO: `/v3/projects/a0931db64dbf4878a46d96581c02dfb8/users/fecf2578448947aa8fa684a21375a7b9/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:16.851464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a689b7e-5e40-42f1-b3f3-f9cbc7396140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0931db64dbf4878a46d96581c02dfb8, user_id=fecf2578448947aa8fa684a21375a7b9, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:16.854135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a689b7e-5e40-42f1-b3f3-f9cbc7396140 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:16.865467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1144/2319] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:16 2022] PUT /identity/v3/projects/a0931db64dbf4878a46d96581c02dfb8/users/fecf2578448947aa8fa684a21375a7b9/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:16.875898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2ad5-7260-49d3-b948-7b07d897288a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:16.876240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2ad5-7260-49d3-b948-7b07d897288a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:16.876555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2ad5-7260-49d3-b948-7b07d897288a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:16.906604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4f0c2ad5-7260-49d3-b948-7b07d897288a None None] MFA Rules not processed for user `fecf2578448947aa8fa684a21375a7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:16.908191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4f0c2ad5-7260-49d3-b948-7b07d897288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:16.944033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a689b7e-5e40-42f1-b3f3-f9cbc7396140 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:16.946992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1a689b7e-5e40-42f1-b3f3-f9cbc7396140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:17.040224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a689b7e-5e40-42f1-b3f3-f9cbc7396140 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:17.040510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1176/2320] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:17.041257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:17.045906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:17.045906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:17.055269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2ad5-7260-49d3-b948-7b07d897288a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:17.055597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] PATH_INFO: `/v3/projects/ba137e6f7a994f3a8ceed9c178357b1d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:17.057786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba137e6f7a994f3a8ceed9c178357b1d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:17.057956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4f0c2ad5-7260-49d3-b948-7b07d897288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:17.060808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:17.140654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2ad5-7260-49d3-b948-7b07d897288a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:17.144471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:17.145180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:17.145466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:17.145790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:17.148040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:17.208706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba137e6f7a994f3a8ceed9c178357b1d', 'request_id': 'req-2a57cc99-0271-49a4-9afc-1165e4ff5b25'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.209831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:17.211456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:17.215653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba137e6f7a994f3a8ceed9c178357b1d', 'request_id': 'req-2a57cc99-0271-49a4-9afc-1165e4ff5b25'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.222238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1177/2321] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:17.223156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba137e6f7a994f3a8ceed9c178357b1d', 'request_id': 'req-2a57cc99-0271-49a4-9afc-1165e4ff5b25'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.227167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:17.286510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:17.288151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:17.304348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4521a5b-ab4b-4ca7-acb5-f6199d6d0232 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:17.317691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] The token cache is being invalidate because project ba137e6f7a994f3a8ceed9c178357b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:17.317912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.327150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.334884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1145/2322] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:16 2022] DELETE /identity/v3/projects/ba137e6f7a994f3a8ceed9c178357b1d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:17.338597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:17.346464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:17.403297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:17.403926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:17.404207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:17.404483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] PATH_INFO: `/v3/projects/7521bbccb929473da7c47b4dc9f660e8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:17.411440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7521bbccb929473da7c47b4dc9f660e8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:17.416284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:17.423365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57cc99-0271-49a4-9afc-1165e4ff5b25 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:17.430318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:17.431123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:17.431411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:17.431825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] PATH_INFO: `/v3/users/bf2083fcd61b494ca91882ee014fcf89` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:17.433123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2083fcd61b494ca91882ee014fcf89)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:17.437951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:17.568738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7521bbccb929473da7c47b4dc9f660e8', 'request_id': 'req-41a5eeda-e8b4-4721-ad1e-e051a75ec459'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.575586 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7521bbccb929473da7c47b4dc9f660e8', 'request_id': 'req-41a5eeda-e8b4-4721-ad1e-e051a75ec459'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.629668 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:17.649024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7521bbccb929473da7c47b4dc9f660e8', 'request_id': 'req-41a5eeda-e8b4-4721-ad1e-e051a75ec459'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.667651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] The token cache is being invalidate because project 7521bbccb929473da7c47b4dc9f660e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:17.668536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.670307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.671873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1178/2323] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:17 2022] DELETE /identity/v3/projects/7521bbccb929473da7c47b4dc9f660e8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:17.672837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:17.674408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:17.684790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2083fcd61b494ca91882ee014fcf89'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.684790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2083fcd61b494ca91882ee014fcf89'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.689652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2083fcd61b494ca91882ee014fcf89'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.690567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2083fcd61b494ca91882ee014fcf89'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.704705 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2083fcd61b494ca91882ee014fcf89'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:17.749413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5eeda-e8b4-4721-ad1e-e051a75ec459 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:17.754234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:17.754866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:17.755150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:17.755705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] PATH_INFO: `/v3/users/0bf6ee15b6394f34a77fa769b8354bd9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:17.756714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf6ee15b6394f34a77fa769b8354bd9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:17.758684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:17.789689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1146/2324] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:17 2022] DELETE /identity/v3/users/bf2083fcd61b494ca91882ee014fcf89 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:17.790995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:17.793524 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:17.872110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b69f0-1f0a-4b30-b8a2-5c0975297a57 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:17.882268 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:17.883275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:17.883275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:17.883557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] PATH_INFO: `/v3/users/93b57aa742ac410ba222d7530e6004bb` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:17.887332 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b57aa742ac410ba222d7530e6004bb)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:17.893593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:18.012439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf6ee15b6394f34a77fa769b8354bd9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.013534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf6ee15b6394f34a77fa769b8354bd9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.058351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf6ee15b6394f34a77fa769b8354bd9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.123759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf6ee15b6394f34a77fa769b8354bd9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.124830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bf35dda3-585a-4d82-ad29-5d8f4bfa0832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf6ee15b6394f34a77fa769b8354bd9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.147594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b57aa742ac410ba222d7530e6004bb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.148393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b57aa742ac410ba222d7530e6004bb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.182810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b57aa742ac410ba222d7530e6004bb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.184448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b57aa742ac410ba222d7530e6004bb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.213573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b57aa742ac410ba222d7530e6004bb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.213885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1179/2325] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:17 2022] DELETE /identity/v3/users/0bf6ee15b6394f34a77fa769b8354bd9 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:18.220183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d737c-0fce-48bf-bb48-13cd4b7133e3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:18.222166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d737c-0fce-48bf-bb48-13cd4b7133e3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:18.222934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d737c-0fce-48bf-bb48-13cd4b7133e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:18.262803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a79d737c-0fce-48bf-bb48-13cd4b7133e3 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:18.264321 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a79d737c-0fce-48bf-bb48-13cd4b7133e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:18.328867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1180/2326] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:18.340684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d737c-0fce-48bf-bb48-13cd4b7133e3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:18.342355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a79d737c-0fce-48bf-bb48-13cd4b7133e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:18.358311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1147/2327] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:17 2022] DELETE /identity/v3/users/93b57aa742ac410ba222d7530e6004bb => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:18.363573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:18.367431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:18.469437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d737c-0fce-48bf-bb48-13cd4b7133e3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:18.510578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6ed9d-eaf1-4941-862e-af03970c0ebe admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:18.517851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:18.519570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:18.519869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:18.520281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] PATH_INFO: `/v3/projects/804ccd55de1a474b9ea57299d73cdeaa` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:18.521959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=804ccd55de1a474b9ea57299d73cdeaa)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:18.529145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:18.573411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b377a-e107-4e85-b141-f3e79559551e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:18.574747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b377a-e107-4e85-b141-f3e79559551e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:18.575038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b377a-e107-4e85-b141-f3e79559551e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:18.575394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b377a-e107-4e85-b141-f3e79559551e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:18.586032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b377a-e107-4e85-b141-f3e79559551e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:18.587583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b377a-e107-4e85-b141-f3e79559551e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:18.598714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1181/2328] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:03:18.701232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804ccd55de1a474b9ea57299d73cdeaa', 'request_id': 'req-6b98d0ff-40c4-4d3d-adad-042e679df06f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.722171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804ccd55de1a474b9ea57299d73cdeaa', 'request_id': 'req-6b98d0ff-40c4-4d3d-adad-042e679df06f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.724670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804ccd55de1a474b9ea57299d73cdeaa', 'request_id': 'req-6b98d0ff-40c4-4d3d-adad-042e679df06f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.813710 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] The token cache is being invalidate because project 804ccd55de1a474b9ea57299d73cdeaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:18.818586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.818586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6b98d0ff-40c4-4d3d-adad-042e679df06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:18.818586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1148/2329] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:18 2022] DELETE /identity/v3/projects/804ccd55de1a474b9ea57299d73cdeaa => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:18.823640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125556f-4290-4b57-a7cb-a50cd0203c87 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:18.823640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125556f-4290-4b57-a7cb-a50cd0203c87 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:18.823640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125556f-4290-4b57-a7cb-a50cd0203c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:18.866530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6125556f-4290-4b57-a7cb-a50cd0203c87 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:18.867839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6125556f-4290-4b57-a7cb-a50cd0203c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:18.978128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1182/2330] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:18.984075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a2ca-55f0-489c-b21f-11471dc2331f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:18.984075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a2ca-55f0-489c-b21f-11471dc2331f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:18.984328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6a2ca-55f0-489c-b21f-11471dc2331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.008630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-efd6a2ca-55f0-489c-b21f-11471dc2331f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:19.009957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-efd6a2ca-55f0-489c-b21f-11471dc2331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.022598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1149/2331] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:19.028657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125556f-4290-4b57-a7cb-a50cd0203c87 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.041837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125556f-4290-4b57-a7cb-a50cd0203c87 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.052009 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:19.056012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.056723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.057002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.057317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.057980 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:19.058978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.060792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:19.073313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1183/2332] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:19.078191 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a2ca-55f0-489c-b21f-11471dc2331f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.087689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6a2ca-55f0-489c-b21f-11471dc2331f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.093426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24598-a3a0-4b73-bca3-bd0eb2b8d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.094028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24598-a3a0-4b73-bca3-bd0eb2b8d7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.094387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24598-a3a0-4b73-bca3-bd0eb2b8d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.094702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24598-a3a0-4b73-bca3-bd0eb2b8d7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.095339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24598-a3a0-4b73-bca3-bd0eb2b8d7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.097471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24598-a3a0-4b73-bca3-bd0eb2b8d7b9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:19.109191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.111206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.149656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be3086-9c98-49fa-a821-a7ce2f40cb62 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.157518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.158313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.158923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.159243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] PATH_INFO: `/v3/projects/e5c0b8b182694f269a589b9b9738cbe1` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.160576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c0b8b182694f269a589b9b9738cbe1)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.162527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:19.212850 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1150/2333] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:19 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:19.214214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24598-a3a0-4b73-bca3-bd0eb2b8d7b9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.218674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bcd24598-a3a0-4b73-bca3-bd0eb2b8d7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.301002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24598-a3a0-4b73-bca3-bd0eb2b8d7b9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.310289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c0b8b182694f269a589b9b9738cbe1', 'request_id': 'req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.318302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c0b8b182694f269a589b9b9738cbe1', 'request_id': 'req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.362938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.363590 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.363878 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.364154 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] PATH_INFO: `/v3/projects/b75424d52aa04a749c7a24a6fb787aa8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.365366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75424d52aa04a749c7a24a6fb787aa8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.370322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:19.406676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c0b8b182694f269a589b9b9738cbe1', 'request_id': 'req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.421310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] The token cache is being invalidate because project e5c0b8b182694f269a589b9b9738cbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:19.421608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.422535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.427215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1184/2334] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:19 2022] DELETE /identity/v3/projects/e5c0b8b182694f269a589b9b9738cbe1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:19.427215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.427215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.442752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8a348-8fca-4118-a0cd-84a7b0e85fef admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.451540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c3aa9-ab35-4dae-badb-f8280a73dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.452167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c3aa9-ab35-4dae-badb-f8280a73dc36 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.461499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c3aa9-ab35-4dae-badb-f8280a73dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.461499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c3aa9-ab35-4dae-badb-f8280a73dc36 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.461499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c3aa9-ab35-4dae-badb-f8280a73dc36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.461499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c3aa9-ab35-4dae-badb-f8280a73dc36 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:19.531275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75424d52aa04a749c7a24a6fb787aa8', 'request_id': 'req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.538760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75424d52aa04a749c7a24a6fb787aa8', 'request_id': 'req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.545706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75424d52aa04a749c7a24a6fb787aa8', 'request_id': 'req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.566874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1185/2335] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:19 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:19.566874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb98be-8b38-4a81-ad8b-0b3e24daedc5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.566874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb98be-8b38-4a81-ad8b-0b3e24daedc5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.566874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb98be-8b38-4a81-ad8b-0b3e24daedc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.587233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-50bb98be-8b38-4a81-ad8b-0b3e24daedc5 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:19.588569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-50bb98be-8b38-4a81-ad8b-0b3e24daedc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.639175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] The token cache is being invalidate because project b75424d52aa04a749c7a24a6fb787aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:19.639175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.639175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:19.639175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1151/2336] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:19 2022] DELETE /identity/v3/projects/b75424d52aa04a749c7a24a6fb787aa8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:19.639546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.642943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.660788 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1186/2337] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:19.667724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb98be-8b38-4a81-ad8b-0b3e24daedc5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.669271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-50bb98be-8b38-4a81-ad8b-0b3e24daedc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.684946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb98be-8b38-4a81-ad8b-0b3e24daedc5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.691369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4a30a-3f15-4030-8c24-e7e66b054418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.692075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4a30a-3f15-4030-8c24-e7e66b054418 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.692510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4a30a-3f15-4030-8c24-e7e66b054418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.696378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4a30a-3f15-4030-8c24-e7e66b054418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.696378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4a30a-3f15-4030-8c24-e7e66b054418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.696378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4a30a-3f15-4030-8c24-e7e66b054418 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:19.710256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1187/2338] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:19.711919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3166c-9c9d-415b-9e2b-9f612e876421 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.712647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3166c-9c9d-415b-9e2b-9f612e876421 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.713939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3166c-9c9d-415b-9e2b-9f612e876421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.731696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fb25a-33a0-4dcc-ae35-c71e5c03e5f8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.737569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366be98b-4c83-4e05-b8aa-f892372be3cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.738305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366be98b-4c83-4e05-b8aa-f892372be3cb service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.738650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366be98b-4c83-4e05-b8aa-f892372be3cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.738997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366be98b-4c83-4e05-b8aa-f892372be3cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.741059 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-366be98b-4c83-4e05-b8aa-f892372be3cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.748428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:19.762407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a6a3166c-9c9d-415b-9e2b-9f612e876421 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:19.764500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a6a3166c-9c9d-415b-9e2b-9f612e876421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.777500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1188/2339] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:19.784125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929a446-3d65-4484-bda4-3bb4a2536404 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.784397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929a446-3d65-4484-bda4-3bb4a2536404 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.784651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929a446-3d65-4484-bda4-3bb4a2536404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.807091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b929a446-3d65-4484-bda4-3bb4a2536404 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:19.808325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b929a446-3d65-4484-bda4-3bb4a2536404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.817414 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1189/2340] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:19.818273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929a446-3d65-4484-bda4-3bb4a2536404 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.829664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929a446-3d65-4484-bda4-3bb4a2536404 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.834853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366be98b-4c83-4e05-b8aa-f892372be3cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.836320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366be98b-4c83-4e05-b8aa-f892372be3cb service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:19.836690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a06f6-3bcb-413a-8638-2da363815cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.837488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a06f6-3bcb-413a-8638-2da363815cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.837911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a06f6-3bcb-413a-8638-2da363815cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.838532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a06f6-3bcb-413a-8638-2da363815cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.839392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a06f6-3bcb-413a-8638-2da363815cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.844045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a06f6-3bcb-413a-8638-2da363815cdb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:19.853841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1152/2341] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:19.855196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6f317-56a8-40c2-b4f9-999556fafab9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.856011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6f317-56a8-40c2-b4f9-999556fafab9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.856425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6f317-56a8-40c2-b4f9-999556fafab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.857212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1190/2342] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:19.858268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a06f6-3bcb-413a-8638-2da363815cdb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.873304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a06f6-3bcb-413a-8638-2da363815cdb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.879257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fd264-be21-41c4-ba7d-13e93c8944b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.880368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fd264-be21-41c4-ba7d-13e93c8944b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.880810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fd264-be21-41c4-ba7d-13e93c8944b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.881251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fd264-be21-41c4-ba7d-13e93c8944b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.882071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fd264-be21-41c4-ba7d-13e93c8944b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:19.882650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fd264-be21-41c4-ba7d-13e93c8944b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.884383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7bf6f317-56a8-40c2-b4f9-999556fafab9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:19.884688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fd264-be21-41c4-ba7d-13e93c8944b0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:19.886120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7bf6f317-56a8-40c2-b4f9-999556fafab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.902978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1153/2343] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:19.902978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6358b-5b9f-44f8-bc29-720ff5e97fa4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.902978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6358b-5b9f-44f8-bc29-720ff5e97fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.902978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6358b-5b9f-44f8-bc29-720ff5e97fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.906621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1191/2344] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:19.908001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fd264-be21-41c4-ba7d-13e93c8944b0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:19.920936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fd264-be21-41c4-ba7d-13e93c8944b0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:19.927175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d0ac8-e5d4-4e28-87b0-e843fabdfcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:19.928065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4bf6358b-5b9f-44f8-bc29-720ff5e97fa4 None None] MFA Rules not processed for user `7d1240c674d74311b58fcafe2886ef2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:19.928260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d0ac8-e5d4-4e28-87b0-e843fabdfcb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:19.928543 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d0ac8-e5d4-4e28-87b0-e843fabdfcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:19.929458 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d0ac8-e5d4-4e28-87b0-e843fabdfcb4 admin admin] PATH_INFO: `/v3/projects/12c59461d66b4df1815882e635d74ad8/users/576fc05d04df45a1a13005361bef8d3c/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:19.930346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4bf6358b-5b9f-44f8-bc29-720ff5e97fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:19.966589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d0ac8-e5d4-4e28-87b0-e843fabdfcb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c59461d66b4df1815882e635d74ad8, user_id=576fc05d04df45a1a13005361bef8d3c, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:19.969235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d0ac8-e5d4-4e28-87b0-e843fabdfcb4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.016704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1154/2345] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:20.016704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6358b-5b9f-44f8-bc29-720ff5e97fa4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.029988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6358b-5b9f-44f8-bc29-720ff5e97fa4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.032832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1192/2346] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:19 2022] PUT /identity/v3/projects/12c59461d66b4df1815882e635d74ad8/users/576fc05d04df45a1a13005361bef8d3c/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:20.033887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d0ac8-e5d4-4e28-87b0-e843fabdfcb4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.128561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76284571-9e5b-486e-9ab6-f8e4929b626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.130107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76284571-9e5b-486e-9ab6-f8e4929b626e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.130463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76284571-9e5b-486e-9ab6-f8e4929b626e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.130943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76284571-9e5b-486e-9ab6-f8e4929b626e admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.131949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76284571-9e5b-486e-9ab6-f8e4929b626e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:20.132482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76284571-9e5b-486e-9ab6-f8e4929b626e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.134559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76284571-9e5b-486e-9ab6-f8e4929b626e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.152411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1155/2347] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:20.154728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f03ed5-3f01-4825-abda-274f807fae4a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.154955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f03ed5-3f01-4825-abda-274f807fae4a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.155409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f03ed5-3f01-4825-abda-274f807fae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.164813 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d0ac8-e5d4-4e28-87b0-e843fabdfcb4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.180509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af59a1-a254-4ea3-9980-ca7bd68e6adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.181154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af59a1-a254-4ea3-9980-ca7bd68e6adb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.181533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af59a1-a254-4ea3-9980-ca7bd68e6adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.181692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af59a1-a254-4ea3-9980-ca7bd68e6adb admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.182940 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af59a1-a254-4ea3-9980-ca7bd68e6adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.184450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-85f03ed5-3f01-4825-abda-274f807fae4a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:20.185872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-85f03ed5-3f01-4825-abda-274f807fae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:20.185993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af59a1-a254-4ea3-9980-ca7bd68e6adb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.195816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1156/2348] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:20.201459 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f03ed5-3f01-4825-abda-274f807fae4a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.214053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f03ed5-3f01-4825-abda-274f807fae4a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.220659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057efdf-df3e-4090-8ada-5530ddd8a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.222453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057efdf-df3e-4090-8ada-5530ddd8a146 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.223283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057efdf-df3e-4090-8ada-5530ddd8a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.223641 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057efdf-df3e-4090-8ada-5530ddd8a146 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.224285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057efdf-df3e-4090-8ada-5530ddd8a146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.226247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057efdf-df3e-4090-8ada-5530ddd8a146 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.284303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1193/2349] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:20 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:20.285197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af59a1-a254-4ea3-9980-ca7bd68e6adb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.299016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18af59a1-a254-4ea3-9980-ca7bd68e6adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:20.365764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1157/2350] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:20 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:20.366736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057efdf-df3e-4090-8ada-5530ddd8a146 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.447269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af59a1-a254-4ea3-9980-ca7bd68e6adb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.507100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057efdf-df3e-4090-8ada-5530ddd8a146 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.520334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38600cbb-952c-451f-9aca-f7725f3390e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.520804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38600cbb-952c-451f-9aca-f7725f3390e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.521087 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38600cbb-952c-451f-9aca-f7725f3390e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.521362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38600cbb-952c-451f-9aca-f7725f3390e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.522004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38600cbb-952c-451f-9aca-f7725f3390e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.522261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf92f-2ecf-4c9c-887b-02ba28cae6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.522871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf92f-2ecf-4c9c-887b-02ba28cae6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.523159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf92f-2ecf-4c9c-887b-02ba28cae6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.523567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf92f-2ecf-4c9c-887b-02ba28cae6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.523996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38600cbb-952c-451f-9aca-f7725f3390e0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.537158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcf92f-2ecf-4c9c-887b-02ba28cae6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.539301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcf92f-2ecf-4c9c-887b-02ba28cae6c7 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.547558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:20.555744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1194/2351] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:20.556362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf92f-2ecf-4c9c-887b-02ba28cae6c7 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.567838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf92f-2ecf-4c9c-887b-02ba28cae6c7 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.574356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36132a22-8053-4598-b71e-f71c2b7d6633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.575182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36132a22-8053-4598-b71e-f71c2b7d6633 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.575529 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36132a22-8053-4598-b71e-f71c2b7d6633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.575875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36132a22-8053-4598-b71e-f71c2b7d6633 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.576780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36132a22-8053-4598-b71e-f71c2b7d6633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.579461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36132a22-8053-4598-b71e-f71c2b7d6633 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.649490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1158/2352] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:20 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:20.654268 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38600cbb-952c-451f-9aca-f7725f3390e0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.667960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38600cbb-952c-451f-9aca-f7725f3390e0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.677420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1195/2353] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:20 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:20.678372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ed5ac-6637-4910-9b22-a04565e28aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.679837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36132a22-8053-4598-b71e-f71c2b7d6633 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.681024 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed5ac-6637-4910-9b22-a04565e28aca admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.681325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed5ac-6637-4910-9b22-a04565e28aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.681661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ed5ac-6637-4910-9b22-a04565e28aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.682358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ed5ac-6637-4910-9b22-a04565e28aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.684303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ed5ac-6637-4910-9b22-a04565e28aca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.694354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36132a22-8053-4598-b71e-f71c2b7d6633 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.696359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1159/2354] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:03:20.701100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ed5ac-6637-4910-9b22-a04565e28aca admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.707740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abeb35-8f02-45c4-9fde-90a38d13c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.708366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abeb35-8f02-45c4-9fde-90a38d13c331 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.711148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abeb35-8f02-45c4-9fde-90a38d13c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.711685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abeb35-8f02-45c4-9fde-90a38d13c331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.712658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abeb35-8f02-45c4-9fde-90a38d13c331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.715434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abeb35-8f02-45c4-9fde-90a38d13c331 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.721985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ed5ac-6637-4910-9b22-a04565e28aca admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.730687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1196/2355] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:20.731619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c212-0f32-4d71-8dd8-845fa90bb812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.732485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c212-0f32-4d71-8dd8-845fa90bb812 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.733651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c212-0f32-4d71-8dd8-845fa90bb812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.734167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c212-0f32-4d71-8dd8-845fa90bb812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.734701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abeb35-8f02-45c4-9fde-90a38d13c331 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.735477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907c212-0f32-4d71-8dd8-845fa90bb812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.738075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907c212-0f32-4d71-8dd8-845fa90bb812 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.746304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abeb35-8f02-45c4-9fde-90a38d13c331 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.751993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795e2e4-b503-4e57-be1c-dddb517fad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.752552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795e2e4-b503-4e57-be1c-dddb517fad9d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.753054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795e2e4-b503-4e57-be1c-dddb517fad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.753400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795e2e4-b503-4e57-be1c-dddb517fad9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.754276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795e2e4-b503-4e57-be1c-dddb517fad9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.755747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1160/2356] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:03:20.759292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c212-0f32-4d71-8dd8-845fa90bb812 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.759652 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795e2e4-b503-4e57-be1c-dddb517fad9d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.772885 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1197/2357] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:03:20.773494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c212-0f32-4d71-8dd8-845fa90bb812 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.776936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795e2e4-b503-4e57-be1c-dddb517fad9d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:20.780397 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04432d0e-c98f-415e-99f3-a4acad338892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.784075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04432d0e-c98f-415e-99f3-a4acad338892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.784075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04432d0e-c98f-415e-99f3-a4acad338892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.784075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04432d0e-c98f-415e-99f3-a4acad338892 admin admin] PATH_INFO: `/v3/projects/69550bedfe4d4a38b6af40f8c21505b7/users/384c7579856941a085a7ec949b97383d/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.792362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795e2e4-b503-4e57-be1c-dddb517fad9d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:20.796527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:20.812771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648dc9a-711e-4c9c-b7a0-4f99e1e2afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:20.814136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648dc9a-711e-4c9c-b7a0-4f99e1e2afa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.814608 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648dc9a-711e-4c9c-b7a0-4f99e1e2afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.815103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648dc9a-711e-4c9c-b7a0-4f99e1e2afa0 admin admin] PATH_INFO: `/v3/projects/dadc62a0f07f44fd8e6383a5c9e349d2/users/348f6d7099474deab41e92835173f7b4/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.818097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04432d0e-c98f-415e-99f3-a4acad338892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69550bedfe4d4a38b6af40f8c21505b7, user_id=384c7579856941a085a7ec949b97383d, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.832300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04432d0e-c98f-415e-99f3-a4acad338892 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.846154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648dc9a-711e-4c9c-b7a0-4f99e1e2afa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dadc62a0f07f44fd8e6383a5c9e349d2, user_id=348f6d7099474deab41e92835173f7b4, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:20.872060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648dc9a-711e-4c9c-b7a0-4f99e1e2afa0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:20.922122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1161/2358] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:20 2022] PUT /identity/v3/projects/69550bedfe4d4a38b6af40f8c21505b7/users/384c7579856941a085a7ec949b97383d/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:20.930483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a87a-0b91-4220-a149-20d7844679a4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.935616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a87a-0b91-4220-a149-20d7844679a4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.935945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a87a-0b91-4220-a149-20d7844679a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:20.968127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1198/2359] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:20 2022] PUT /identity/v3/projects/dadc62a0f07f44fd8e6383a5c9e349d2/users/348f6d7099474deab41e92835173f7b4/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:20.971730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897ee9a-148f-4d97-8da7-545efdb01228 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:20.972124 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897ee9a-148f-4d97-8da7-545efdb01228 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:20.979054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897ee9a-148f-4d97-8da7-545efdb01228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:21.007605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b807a87a-0b91-4220-a149-20d7844679a4 None None] MFA Rules not processed for user `384c7579856941a085a7ec949b97383d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:21.009060 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b807a87a-0b91-4220-a149-20d7844679a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:21.060700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f897ee9a-148f-4d97-8da7-545efdb01228 None None] MFA Rules not processed for user `348f6d7099474deab41e92835173f7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:21.063346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f897ee9a-148f-4d97-8da7-545efdb01228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:21.125787 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1162/2360] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:21.148292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a87a-0b91-4220-a149-20d7844679a4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:21.151469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b807a87a-0b91-4220-a149-20d7844679a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:21.234837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1199/2361] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:21.247700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897ee9a-148f-4d97-8da7-545efdb01228 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:21.251546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f897ee9a-148f-4d97-8da7-545efdb01228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:21.269085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a87a-0b91-4220-a149-20d7844679a4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:21.309938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f401-c758-40bb-abe0-3599339e8613 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8339b6461e4e28bc397dcd3f85e1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:21.318243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f401-c758-40bb-abe0-3599339e8613 service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:21.318243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f401-c758-40bb-abe0-3599339e8613 service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:21.318243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f401-c758-40bb-abe0-3599339e8613 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:21.333387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f401-c758-40bb-abe0-3599339e8613 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:21.334884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f401-c758-40bb-abe0-3599339e8613 service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:21.358250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1163/2362] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:21.378912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897ee9a-148f-4d97-8da7-545efdb01228 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:21.383917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44bf04-6dfb-40d6-bc16-1d69e6c8250d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:21.384772 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44bf04-6dfb-40d6-bc16-1d69e6c8250d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:21.385184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44bf04-6dfb-40d6-bc16-1d69e6c8250d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:21.385586 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44bf04-6dfb-40d6-bc16-1d69e6c8250d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:21.400012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44bf04-6dfb-40d6-bc16-1d69e6c8250d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:21.403048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44bf04-6dfb-40d6-bc16-1d69e6c8250d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:21.430247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1200/2363] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:22.458528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f401-c758-40bb-abe0-3599339e8613 service glance] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:22.477867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f401-c758-40bb-abe0-3599339e8613 service glance] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:22.483448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ab211-80a7-4119-917c-8ce89e32f773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:22.485453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ab211-80a7-4119-917c-8ce89e32f773 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:22.485453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ab211-80a7-4119-917c-8ce89e32f773 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:22.485453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ab211-80a7-4119-917c-8ce89e32f773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:22.487979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-078ab211-80a7-4119-917c-8ce89e32f773 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:22.554030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ab211-80a7-4119-917c-8ce89e32f773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:22.555678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ab211-80a7-4119-917c-8ce89e32f773 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:22.571352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1164/2364] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:22.715026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1e723-04e5-4c2c-a345-4ce9bbce62d4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:22.717076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1e723-04e5-4c2c-a345-4ce9bbce62d4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:22.717745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1e723-04e5-4c2c-a345-4ce9bbce62d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:22.773381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3de1e723-04e5-4c2c-a345-4ce9bbce62d4 None None] MFA Rules not processed for user `576fc05d04df45a1a13005361bef8d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:22.775965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3de1e723-04e5-4c2c-a345-4ce9bbce62d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:22.784082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:22.897804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1201/2365] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:22.912305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ab211-80a7-4119-917c-8ce89e32f773 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:22.923292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ab211-80a7-4119-917c-8ce89e32f773 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:22.930337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bc674-8d7e-4e30-b508-ebed4d198ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:22.934599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bc674-8d7e-4e30-b508-ebed4d198ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:22.934599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bc674-8d7e-4e30-b508-ebed4d198ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:22.934599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bc674-8d7e-4e30-b508-ebed4d198ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:22.956185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bc674-8d7e-4e30-b508-ebed4d198ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:22.957932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bc674-8d7e-4e30-b508-ebed4d198ec6 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:22.974302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1165/2366] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:23.277344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:23.415239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff3f68-29bb-43b9-984a-b428e4de53c4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:23.415532 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff3f68-29bb-43b9-984a-b428e4de53c4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:23.415806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff3f68-29bb-43b9-984a-b428e4de53c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:23.436383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fbff3f68-29bb-43b9-984a-b428e4de53c4 None None] MFA Rules not processed for user `348f6d7099474deab41e92835173f7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:23.437597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fbff3f68-29bb-43b9-984a-b428e4de53c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:23.444641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1202/2367] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:24.828249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce31d5-8b31-4025-8ae0-afe7dd750373 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:24.829194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce31d5-8b31-4025-8ae0-afe7dd750373 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:24.829673 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce31d5-8b31-4025-8ae0-afe7dd750373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:24.854931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-46ce31d5-8b31-4025-8ae0-afe7dd750373 None None] MFA Rules not processed for user `576fc05d04df45a1a13005361bef8d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:24.857058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-46ce31d5-8b31-4025-8ae0-afe7dd750373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:24.869327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1166/2368] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:25.086674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:25.616191 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:27.617626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:27.778601 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:27.995126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff3f68-29bb-43b9-984a-b428e4de53c4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:27.996545 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fbff3f68-29bb-43b9-984a-b428e4de53c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:28.080973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff3f68-29bb-43b9-984a-b428e4de53c4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:28.085799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:28.086547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:28.086898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:28.087243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] PATH_INFO: `/v3/users/ea0a3d21442640c89553e2e1fdb35b0e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:28.088463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0a3d21442640c89553e2e1fdb35b0e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:28.091216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:28.355159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0a3d21442640c89553e2e1fdb35b0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:28.356866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0a3d21442640c89553e2e1fdb35b0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:28.364693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0a3d21442640c89553e2e1fdb35b0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:28.444196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0a3d21442640c89553e2e1fdb35b0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:28.448225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0a3d21442640c89553e2e1fdb35b0e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:28.464988 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1203/2369] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:27 2022] DELETE /identity/v3/users/ea0a3d21442640c89553e2e1fdb35b0e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:28.469195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5113-8de2-446d-8d5a-dced697f5a1c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:28.469470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5113-8de2-446d-8d5a-dced697f5a1c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:28.470231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5113-8de2-446d-8d5a-dced697f5a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:28.492190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e18d5113-8de2-446d-8d5a-dced697f5a1c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:28.498365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e18d5113-8de2-446d-8d5a-dced697f5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:28.557143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1167/2370] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:28.566774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:28.569409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:28.644515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1ce55-64aa-46c7-9060-409f7aaab535 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:28.649831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e0d51-14f7-40db-b768-e1c0794b6e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:28.650636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e0d51-14f7-40db-b768-e1c0794b6e04 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:28.650986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e0d51-14f7-40db-b768-e1c0794b6e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:28.651366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e0d51-14f7-40db-b768-e1c0794b6e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:28.675630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e0d51-14f7-40db-b768-e1c0794b6e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:28.677113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e0d51-14f7-40db-b768-e1c0794b6e04 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:28.688151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1204/2371] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:29.138431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:29.162127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d5113-8de2-446d-8d5a-dced697f5a1c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:29.163620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e18d5113-8de2-446d-8d5a-dced697f5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:29.176374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d5113-8de2-446d-8d5a-dced697f5a1c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:29.182396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:29.189178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:29.189178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:29.189178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] PATH_INFO: `/v3/projects/75cfbc3375164e82875c7b7078de5a66` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:29.189178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cfbc3375164e82875c7b7078de5a66)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:29.189178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:29.202005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:29.311415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cfbc3375164e82875c7b7078de5a66', 'request_id': 'req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.319930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cfbc3375164e82875c7b7078de5a66', 'request_id': 'req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.326781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cfbc3375164e82875c7b7078de5a66', 'request_id': 'req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.435987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] The token cache is being invalidate because project 75cfbc3375164e82875c7b7078de5a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:29.438471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.438471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.441393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1168/2372] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:29 2022] DELETE /identity/v3/projects/75cfbc3375164e82875c7b7078de5a66 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:29.442589 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e0d51-14f7-40db-b768-e1c0794b6e04 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:29.453511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e0d51-14f7-40db-b768-e1c0794b6e04 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:29.515994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:29.516624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:29.517012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:29.517467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] PATH_INFO: `/v3/users/4f3c1ddb2ad449c5a256decb06b840c2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:29.519200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3c1ddb2ad449c5a256decb06b840c2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:29.524936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:29.566836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:29.648759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3c1ddb2ad449c5a256decb06b840c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.649454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3c1ddb2ad449c5a256decb06b840c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.657700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3c1ddb2ad449c5a256decb06b840c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.708800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3c1ddb2ad449c5a256decb06b840c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.709483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3c1ddb2ad449c5a256decb06b840c2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:29.742577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1205/2373] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:29 2022] DELETE /identity/v3/users/4f3c1ddb2ad449c5a256decb06b840c2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:30.321521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:30.538629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:30.691799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:30.693471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:30.711545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57dfc46-8e67-4d3f-88c2-4a56e21862ef admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:30.796435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:30.797075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:30.797358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:30.797635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] PATH_INFO: `/v3/projects/e5334a2a285f4108abcc21ee59b31949` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:30.798812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5334a2a285f4108abcc21ee59b31949)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:30.800756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:30.927648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5334a2a285f4108abcc21ee59b31949', 'request_id': 'req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:30.934582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5334a2a285f4108abcc21ee59b31949', 'request_id': 'req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:30.945314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5334a2a285f4108abcc21ee59b31949', 'request_id': 'req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:31.022270 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] The token cache is being invalidate because project e5334a2a285f4108abcc21ee59b31949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:31.022800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:31.023500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:31.025020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1169/2374] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:30 2022] DELETE /identity/v3/projects/e5334a2a285f4108abcc21ee59b31949 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:31.029448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:31.031035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:31.050693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53070f4-d23e-4d91-95d8-91e334f181a3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:31.131601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:31.132240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:31.132711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:31.132993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] PATH_INFO: `/v3/users/fecf2578448947aa8fa684a21375a7b9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:31.134285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fecf2578448947aa8fa684a21375a7b9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:31.136758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:31.363271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fecf2578448947aa8fa684a21375a7b9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:31.364219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fecf2578448947aa8fa684a21375a7b9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:31.376978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fecf2578448947aa8fa684a21375a7b9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:31.395968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:31.468976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fecf2578448947aa8fa684a21375a7b9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:31.472570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-677c1f09-0e6c-4efa-a158-b8f2ea4b40a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fecf2578448947aa8fa684a21375a7b9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:31.493896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1206/2375] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:31 2022] DELETE /identity/v3/users/fecf2578448947aa8fa684a21375a7b9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:31.679673 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:32.033301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:32.033987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:32.054265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e6dbb-d79a-403d-9e4c-90b1e99251cd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:32.163200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:32.164991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:32.165509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:32.166063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] PATH_INFO: `/v3/projects/a0931db64dbf4878a46d96581c02dfb8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:32.170683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0931db64dbf4878a46d96581c02dfb8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:32.172715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:32.340385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0931db64dbf4878a46d96581c02dfb8', 'request_id': 'req-158142be-a58e-4eea-8479-7c4d631b00a4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:32.347391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0931db64dbf4878a46d96581c02dfb8', 'request_id': 'req-158142be-a58e-4eea-8479-7c4d631b00a4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:32.353212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:32.356094 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0931db64dbf4878a46d96581c02dfb8', 'request_id': 'req-158142be-a58e-4eea-8479-7c4d631b00a4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:32.453148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] The token cache is being invalidate because project a0931db64dbf4878a46d96581c02dfb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:32.453760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:32.458233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-158142be-a58e-4eea-8479-7c4d631b00a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:32.458233 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1170/2376] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:32 2022] DELETE /identity/v3/projects/a0931db64dbf4878a46d96581c02dfb8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:32.461023 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b634-a827-4840-9fb6-1bdb5ba02104 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:32.461548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b634-a827-4840-9fb6-1bdb5ba02104 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:32.462047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06b634-a827-4840-9fb6-1bdb5ba02104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:32.499038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cd06b634-a827-4840-9fb6-1bdb5ba02104 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:32.504314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cd06b634-a827-4840-9fb6-1bdb5ba02104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:32.570206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1207/2377] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:32.579718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eed6a-778b-4605-81cc-471d546a8b96 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:32.580009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eed6a-778b-4605-81cc-471d546a8b96 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:32.580288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eed6a-778b-4605-81cc-471d546a8b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:32.601265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d15eed6a-778b-4605-81cc-471d546a8b96 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:32.602640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d15eed6a-778b-4605-81cc-471d546a8b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:32.611503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1171/2378] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:32.619156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b634-a827-4840-9fb6-1bdb5ba02104 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:32.629478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06b634-a827-4840-9fb6-1bdb5ba02104 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:32.634151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797388f6-7903-4496-89f7-0cabce6d7eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:32.636479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797388f6-7903-4496-89f7-0cabce6d7eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:32.636479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797388f6-7903-4496-89f7-0cabce6d7eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:32.636479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797388f6-7903-4496-89f7-0cabce6d7eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:32.636760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797388f6-7903-4496-89f7-0cabce6d7eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:32.636844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797388f6-7903-4496-89f7-0cabce6d7eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:32.638528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797388f6-7903-4496-89f7-0cabce6d7eb4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:32.651249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1208/2379] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:32.656454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eed6a-778b-4605-81cc-471d546a8b96 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:32.666892 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eed6a-778b-4605-81cc-471d546a8b96 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:32.685194 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda88b7a-0a92-487d-862f-8334784abcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:32.685918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda88b7a-0a92-487d-862f-8334784abcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:32.686561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda88b7a-0a92-487d-862f-8334784abcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:32.686850 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda88b7a-0a92-487d-862f-8334784abcd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:32.690997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda88b7a-0a92-487d-862f-8334784abcd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:32.690997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda88b7a-0a92-487d-862f-8334784abcd0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:32.770168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1172/2380] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:32 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:32.774031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797388f6-7903-4496-89f7-0cabce6d7eb4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:32.791597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797388f6-7903-4496-89f7-0cabce6d7eb4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:32.867126 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:32.895884 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4838f1-ab0e-402d-979e-87b7599346d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:32.896528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4838f1-ab0e-402d-979e-87b7599346d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:32.896822 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4838f1-ab0e-402d-979e-87b7599346d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:32.897103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4838f1-ab0e-402d-979e-87b7599346d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:32.897785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4838f1-ab0e-402d-979e-87b7599346d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:32.899727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4838f1-ab0e-402d-979e-87b7599346d3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:32.974391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1209/2381] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:32 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:32.977091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda88b7a-0a92-487d-862f-8334784abcd0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:32.989005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:32.997310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda88b7a-0a92-487d-862f-8334784abcd0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:33.002889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27077e7a-b7ca-424d-adca-8cec246c645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:33.003724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27077e7a-b7ca-424d-adca-8cec246c645c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:33.004009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27077e7a-b7ca-424d-adca-8cec246c645c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:33.004285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27077e7a-b7ca-424d-adca-8cec246c645c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:33.004945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27077e7a-b7ca-424d-adca-8cec246c645c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:33.006704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27077e7a-b7ca-424d-adca-8cec246c645c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:33.024277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1173/2382] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:33.027624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4838f1-ab0e-402d-979e-87b7599346d3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:33.039983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4838f1-ab0e-402d-979e-87b7599346d3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:33.045232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f109a5-b031-410b-9eb5-5856259eb413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:33.045868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f109a5-b031-410b-9eb5-5856259eb413 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:33.046195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f109a5-b031-410b-9eb5-5856259eb413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:33.046467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f109a5-b031-410b-9eb5-5856259eb413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:33.047119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f109a5-b031-410b-9eb5-5856259eb413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:33.048713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f109a5-b031-410b-9eb5-5856259eb413 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:33.064636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1210/2383] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:03:33.065962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27077e7a-b7ca-424d-adca-8cec246c645c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:33.079746 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27077e7a-b7ca-424d-adca-8cec246c645c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:33.084832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21a09b-86ee-4210-98db-c16e33dc561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:33.085385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21a09b-86ee-4210-98db-c16e33dc561a admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:33.085689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21a09b-86ee-4210-98db-c16e33dc561a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:33.090760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21a09b-86ee-4210-98db-c16e33dc561a admin admin] PATH_INFO: `/v3/projects/b0afb1a3ab174b349674ec6f0f932377/users/33d0c29eb66e408f95ac6a22ede6fab9/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:33.101342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21a09b-86ee-4210-98db-c16e33dc561a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0afb1a3ab174b349674ec6f0f932377, user_id=33d0c29eb66e408f95ac6a22ede6fab9, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:33.104253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21a09b-86ee-4210-98db-c16e33dc561a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:33.175845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1174/2384] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:33 2022] PUT /identity/v3/projects/b0afb1a3ab174b349674ec6f0f932377/users/33d0c29eb66e408f95ac6a22ede6fab9/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:33.187626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14991aa-640d-47a4-8dc8-3145f3986340 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:33.187626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14991aa-640d-47a4-8dc8-3145f3986340 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:33.188668 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14991aa-640d-47a4-8dc8-3145f3986340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:33.204705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:33.247356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d14991aa-640d-47a4-8dc8-3145f3986340 None None] MFA Rules not processed for user `33d0c29eb66e408f95ac6a22ede6fab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:33.248343 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d14991aa-640d-47a4-8dc8-3145f3986340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:33.349776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1211/2385] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:33.362585 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21a09b-86ee-4210-98db-c16e33dc561a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:33.364365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fb21a09b-86ee-4210-98db-c16e33dc561a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:33.444042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21a09b-86ee-4210-98db-c16e33dc561a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:33.448996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67210-0115-4af6-ad6e-030bc35edffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:33.449811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67210-0115-4af6-ad6e-030bc35edffa service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:33.450289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67210-0115-4af6-ad6e-030bc35edffa service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:33.450714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67210-0115-4af6-ad6e-030bc35edffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:33.460416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67210-0115-4af6-ad6e-030bc35edffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:33.468922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67210-0115-4af6-ad6e-030bc35edffa service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:33.475704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1175/2386] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:33.583780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:33.623253 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:34.807577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bf2cb-1314-4cac-9361-0272399b0c9e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:34.808222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bf2cb-1314-4cac-9361-0272399b0c9e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:34.808222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bf2cb-1314-4cac-9361-0272399b0c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:34.832455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e17bf2cb-1314-4cac-9361-0272399b0c9e None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:34.833910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e17bf2cb-1314-4cac-9361-0272399b0c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:34.884115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:34.900288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1212/2387] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:03:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:34.948889 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67210-0115-4af6-ad6e-030bc35edffa service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:34.950348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-15d67210-0115-4af6-ad6e-030bc35edffa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:35.022009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67210-0115-4af6-ad6e-030bc35edffa service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:35.027885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b09dd6-4f75-4f0d-9efa-07e3340e680c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:35.028498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b09dd6-4f75-4f0d-9efa-07e3340e680c service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:35.028788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b09dd6-4f75-4f0d-9efa-07e3340e680c service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:35.029065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b09dd6-4f75-4f0d-9efa-07e3340e680c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:35.037157 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b09dd6-4f75-4f0d-9efa-07e3340e680c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:35.043209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b09dd6-4f75-4f0d-9efa-07e3340e680c service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:35.047002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1176/2388] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:03:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:03:36.394690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:45.043581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=79,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:45.916071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bf2cb-1314-4cac-9361-0272399b0c9e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:46.036303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bf2cb-1314-4cac-9361-0272399b0c9e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:46.050241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:46.052984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:46.053648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:46.054048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] PATH_INFO: `/v3/users/33d0c29eb66e408f95ac6a22ede6fab9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:46.055626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d0c29eb66e408f95ac6a22ede6fab9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:46.057739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:46.066924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:46.336448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d0c29eb66e408f95ac6a22ede6fab9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:46.337977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d0c29eb66e408f95ac6a22ede6fab9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:46.353371 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d0c29eb66e408f95ac6a22ede6fab9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:46.423597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d0c29eb66e408f95ac6a22ede6fab9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:46.424863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d0c29eb66e408f95ac6a22ede6fab9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:46.479633 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1213/2389] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:45 2022] DELETE /identity/v3/users/33d0c29eb66e408f95ac6a22ede6fab9 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:46.481498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac97ef-5832-465c-8c4d-cdda53ead638 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:46.481978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac97ef-5832-465c-8c4d-cdda53ead638 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:46.482363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac97ef-5832-465c-8c4d-cdda53ead638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:46.523563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-36ac97ef-5832-465c-8c4d-cdda53ead638 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:46.525652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-36ac97ef-5832-465c-8c4d-cdda53ead638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:46.640521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1177/2390] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:46.659444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:46.661744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:46.780189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23cbed-5b1f-46ea-bb57-2114a62e7f5e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:46.785217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b737157-8211-403f-aed1-398210a75388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:46.786109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b737157-8211-403f-aed1-398210a75388 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:46.786714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b737157-8211-403f-aed1-398210a75388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:46.787294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b737157-8211-403f-aed1-398210a75388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:46.800008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b737157-8211-403f-aed1-398210a75388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:46.802761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b737157-8211-403f-aed1-398210a75388 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:46.837117 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1214/2391] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:47.436527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac97ef-5832-465c-8c4d-cdda53ead638 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:47.439077 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-36ac97ef-5832-465c-8c4d-cdda53ead638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:47.460262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac97ef-5832-465c-8c4d-cdda53ead638 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:47.466950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:47.468038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:47.468549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:47.469064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] PATH_INFO: `/v3/projects/b0afb1a3ab174b349674ec6f0f932377` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:47.471669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0afb1a3ab174b349674ec6f0f932377)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:47.496187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:47.683005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0afb1a3ab174b349674ec6f0f932377', 'request_id': 'req-e605f888-ba88-42df-8bb5-6873c8262daa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:47.692124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0afb1a3ab174b349674ec6f0f932377', 'request_id': 'req-e605f888-ba88-42df-8bb5-6873c8262daa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:47.704391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0afb1a3ab174b349674ec6f0f932377', 'request_id': 'req-e605f888-ba88-42df-8bb5-6873c8262daa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:47.773914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] The token cache is being invalidate because project b0afb1a3ab174b349674ec6f0f932377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:47.774465 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:47.775727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e605f888-ba88-42df-8bb5-6873c8262daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:47.777870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1178/2392] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:47 2022] DELETE /identity/v3/projects/b0afb1a3ab174b349674ec6f0f932377 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:53.143700 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b737157-8211-403f-aed1-398210a75388 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:53.145432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b737157-8211-403f-aed1-398210a75388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:53.159969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b737157-8211-403f-aed1-398210a75388 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:53.222273 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:53.222842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:53.223147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:53.223424 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] PATH_INFO: `/v3/users/384c7579856941a085a7ec949b97383d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:53.224586 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384c7579856941a085a7ec949b97383d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:53.226659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:53.394091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:53.409657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384c7579856941a085a7ec949b97383d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:53.410510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384c7579856941a085a7ec949b97383d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:53.418963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384c7579856941a085a7ec949b97383d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:53.490866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384c7579856941a085a7ec949b97383d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:53.491409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384c7579856941a085a7ec949b97383d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:53.522821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1215/2393] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:53 2022] DELETE /identity/v3/users/384c7579856941a085a7ec949b97383d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:53.528166 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0491f-27eb-4e8e-814d-3e4c2a174b95 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:53.528722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0491f-27eb-4e8e-814d-3e4c2a174b95 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:53.528722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0491f-27eb-4e8e-814d-3e4c2a174b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:53.551938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-92f0491f-27eb-4e8e-814d-3e4c2a174b95 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:53.553471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-92f0491f-27eb-4e8e-814d-3e4c2a174b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:53.642129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1179/2394] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:03:53.653001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:53.654531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:53.727821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c02f0-7d67-4901-9980-169654936c85 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:53.732573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dd8cb-90b5-4821-9832-c496b9f16b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:53.733286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd8cb-90b5-4821-9832-c496b9f16b78 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:53.733507 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd8cb-90b5-4821-9832-c496b9f16b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:53.733788 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd8cb-90b5-4821-9832-c496b9f16b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:53.756605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dd8cb-90b5-4821-9832-c496b9f16b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:53.757995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dd8cb-90b5-4821-9832-c496b9f16b78 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:53.774043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1216/2395] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:54.253834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0491f-27eb-4e8e-814d-3e4c2a174b95 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:54.255860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-92f0491f-27eb-4e8e-814d-3e4c2a174b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:54.284827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0491f-27eb-4e8e-814d-3e4c2a174b95 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:54.300887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:54.302800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:54.303096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:54.303437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] PATH_INFO: `/v3/projects/69550bedfe4d4a38b6af40f8c21505b7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:54.306076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69550bedfe4d4a38b6af40f8c21505b7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:54.310654 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:54.374380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:54.460914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69550bedfe4d4a38b6af40f8c21505b7', 'request_id': 'req-04fa9eee-929d-4224-9c7c-60ae96cc5f55'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:54.471904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69550bedfe4d4a38b6af40f8c21505b7', 'request_id': 'req-04fa9eee-929d-4224-9c7c-60ae96cc5f55'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:54.477822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69550bedfe4d4a38b6af40f8c21505b7', 'request_id': 'req-04fa9eee-929d-4224-9c7c-60ae96cc5f55'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:54.535747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] The token cache is being invalidate because project 69550bedfe4d4a38b6af40f8c21505b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:54.536544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:54.536686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-04fa9eee-929d-4224-9c7c-60ae96cc5f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:54.538246 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1180/2396] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:54 2022] DELETE /identity/v3/projects/69550bedfe4d4a38b6af40f8c21505b7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:54.543316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9ac3-a83d-4bb8-b270-6974dc864523 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:54.543806 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9ac3-a83d-4bb8-b270-6974dc864523 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:54.543912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9ac3-a83d-4bb8-b270-6974dc864523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:54.564317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-45ee9ac3-a83d-4bb8-b270-6974dc864523 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:54.565524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-45ee9ac3-a83d-4bb8-b270-6974dc864523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:54.632927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1217/2397] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:54.640899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8fbf-d95b-44fc-91f3-74577f6e615d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:54.641208 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8fbf-d95b-44fc-91f3-74577f6e615d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:54.641556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c8fbf-d95b-44fc-91f3-74577f6e615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:54.663849 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-710c8fbf-d95b-44fc-91f3-74577f6e615d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:54.665473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-710c8fbf-d95b-44fc-91f3-74577f6e615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:54.675311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1181/2398] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:03:54.679802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9ac3-a83d-4bb8-b270-6974dc864523 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:54.691393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9ac3-a83d-4bb8-b270-6974dc864523 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:54.696352 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c296cd-a5d0-40bd-a225-b1710db96a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:54.697063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c296cd-a5d0-40bd-a225-b1710db96a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:54.697437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c296cd-a5d0-40bd-a225-b1710db96a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:54.697819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c296cd-a5d0-40bd-a225-b1710db96a2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:54.698510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c296cd-a5d0-40bd-a225-b1710db96a2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:54.698955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c296cd-a5d0-40bd-a225-b1710db96a2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:54.700489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c296cd-a5d0-40bd-a225-b1710db96a2e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:54.717056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1218/2399] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:54.718314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8fbf-d95b-44fc-91f3-74577f6e615d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:54.730203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c8fbf-d95b-44fc-91f3-74577f6e615d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:54.735939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde86ba-9af0-4f1f-a7bf-66a88c2f2082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:54.736565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde86ba-9af0-4f1f-a7bf-66a88c2f2082 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:54.736852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde86ba-9af0-4f1f-a7bf-66a88c2f2082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:54.737117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde86ba-9af0-4f1f-a7bf-66a88c2f2082 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:54.737756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde86ba-9af0-4f1f-a7bf-66a88c2f2082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:54.739740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde86ba-9af0-4f1f-a7bf-66a88c2f2082 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:54.824393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1182/2400] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:54 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:03:54.828445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c296cd-a5d0-40bd-a225-b1710db96a2e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:54.839704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c296cd-a5d0-40bd-a225-b1710db96a2e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:54.876288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:54.900751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fab36-3150-4b72-b37a-df664977ec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:54.901895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fab36-3150-4b72-b37a-df664977ec18 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:54.902334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fab36-3150-4b72-b37a-df664977ec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:54.902627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fab36-3150-4b72-b37a-df664977ec18 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:54.903305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fab36-3150-4b72-b37a-df664977ec18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:54.905279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fab36-3150-4b72-b37a-df664977ec18 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:55.015187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1219/2401] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:54 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:03:55.015978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde86ba-9af0-4f1f-a7bf-66a88c2f2082 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:55.026707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde86ba-9af0-4f1f-a7bf-66a88c2f2082 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:55.032391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b80cd6-defb-452f-ab0a-d65931e24344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:55.033005 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b80cd6-defb-452f-ab0a-d65931e24344 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:55.033383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b80cd6-defb-452f-ab0a-d65931e24344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:55.033719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b80cd6-defb-452f-ab0a-d65931e24344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:55.034616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b80cd6-defb-452f-ab0a-d65931e24344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:55.036447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b80cd6-defb-452f-ab0a-d65931e24344 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:55.047786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1183/2402] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:55.052251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fab36-3150-4b72-b37a-df664977ec18 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:55.063040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fab36-3150-4b72-b37a-df664977ec18 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:55.069213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a570ee-cc1b-4cf3-b234-e4519e4e29d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:55.069880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a570ee-cc1b-4cf3-b234-e4519e4e29d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:55.070253 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a570ee-cc1b-4cf3-b234-e4519e4e29d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:55.070697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a570ee-cc1b-4cf3-b234-e4519e4e29d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:55.071481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a570ee-cc1b-4cf3-b234-e4519e4e29d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:55.074241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a570ee-cc1b-4cf3-b234-e4519e4e29d1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:55.087248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1220/2403] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:55.091064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b80cd6-defb-452f-ab0a-d65931e24344 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:55.101621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b80cd6-defb-452f-ab0a-d65931e24344 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:55.106932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041761a8-ceff-4038-948b-c05d5dacba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:55.107640 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041761a8-ceff-4038-948b-c05d5dacba21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:55.107921 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041761a8-ceff-4038-948b-c05d5dacba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:55.108196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041761a8-ceff-4038-948b-c05d5dacba21 admin admin] PATH_INFO: `/v3/projects/cdd3ec045bab450dbdc1c797ad612231/users/5dcba1de3aed46df9510eb303e037cec/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:55.123401 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041761a8-ceff-4038-948b-c05d5dacba21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd3ec045bab450dbdc1c797ad612231, user_id=5dcba1de3aed46df9510eb303e037cec, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:55.126856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041761a8-ceff-4038-948b-c05d5dacba21 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:55.195171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1184/2404] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:55 2022] PUT /identity/v3/projects/cdd3ec045bab450dbdc1c797ad612231/users/5dcba1de3aed46df9510eb303e037cec/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:55.208771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272f4b9-80ad-4201-8dd3-750652cfaefa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:55.209093 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272f4b9-80ad-4201-8dd3-750652cfaefa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:55.209355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272f4b9-80ad-4201-8dd3-750652cfaefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:55.242332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3272f4b9-80ad-4201-8dd3-750652cfaefa None None] MFA Rules not processed for user `5dcba1de3aed46df9510eb303e037cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:55.243655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3272f4b9-80ad-4201-8dd3-750652cfaefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:55.321290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1221/2405] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:55.335177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041761a8-ceff-4038-948b-c05d5dacba21 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:55.337026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-041761a8-ceff-4038-948b-c05d5dacba21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:55.418805 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041761a8-ceff-4038-948b-c05d5dacba21 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:55.423070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38e0ed-7c1d-470d-bf01-a5f44a6ca211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:55.423932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e0ed-7c1d-470d-bf01-a5f44a6ca211 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:55.424046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e0ed-7c1d-470d-bf01-a5f44a6ca211 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:55.424272 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e0ed-7c1d-470d-bf01-a5f44a6ca211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:55.436240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38e0ed-7c1d-470d-bf01-a5f44a6ca211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:55.438684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38e0ed-7c1d-470d-bf01-a5f44a6ca211 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:55.451663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1185/2406] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:55.481657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272f4b9-80ad-4201-8dd3-750652cfaefa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:55.560161 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272f4b9-80ad-4201-8dd3-750652cfaefa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:55.565599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:55.566334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:55.566786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:55.567159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] PATH_INFO: `/v3/users/5dcba1de3aed46df9510eb303e037cec` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:55.568594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcba1de3aed46df9510eb303e037cec)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:55.570637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:55.769417 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcba1de3aed46df9510eb303e037cec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:55.770190 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcba1de3aed46df9510eb303e037cec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:55.771402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:55.778038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcba1de3aed46df9510eb303e037cec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:55.838838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcba1de3aed46df9510eb303e037cec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:55.839619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcba1de3aed46df9510eb303e037cec'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:55.858711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1222/2407] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:55 2022] DELETE /identity/v3/users/5dcba1de3aed46df9510eb303e037cec => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:55.863790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622ebc1-15e2-488d-aff9-ac452c460293 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:55.864301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622ebc1-15e2-488d-aff9-ac452c460293 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:55.864393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622ebc1-15e2-488d-aff9-ac452c460293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:55.885483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b622ebc1-15e2-488d-aff9-ac452c460293 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:55.886845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b622ebc1-15e2-488d-aff9-ac452c460293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:55.949160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:55.969346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1186/2408] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:55.981619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:55.983278 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:56.046916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3da487-1235-444d-8302-7d5d96b7ac27 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:56.051382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b079d-ce70-417b-853c-5bacb82fd96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:56.052251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b079d-ce70-417b-853c-5bacb82fd96e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:56.052536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b079d-ce70-417b-853c-5bacb82fd96e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:56.052811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b079d-ce70-417b-853c-5bacb82fd96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:56.063870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b079d-ce70-417b-853c-5bacb82fd96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:56.065957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b079d-ce70-417b-853c-5bacb82fd96e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:56.079437 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1223/2409] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:56.530647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622ebc1-15e2-488d-aff9-ac452c460293 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:56.532726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b622ebc1-15e2-488d-aff9-ac452c460293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:56.545745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622ebc1-15e2-488d-aff9-ac452c460293 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:56.553479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:56.554054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:56.554773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:56.555049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] PATH_INFO: `/v3/projects/cdd3ec045bab450dbdc1c797ad612231` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:56.556228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd3ec045bab450dbdc1c797ad612231)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:56.558783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:56.667829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd3ec045bab450dbdc1c797ad612231', 'request_id': 'req-b3b09a08-f631-4074-967a-1bb151ab25a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:56.675519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd3ec045bab450dbdc1c797ad612231', 'request_id': 'req-b3b09a08-f631-4074-967a-1bb151ab25a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:56.686056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd3ec045bab450dbdc1c797ad612231', 'request_id': 'req-b3b09a08-f631-4074-967a-1bb151ab25a8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:56.796359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] The token cache is being invalidate because project cdd3ec045bab450dbdc1c797ad612231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:56.796766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:56.799701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3b09a08-f631-4074-967a-1bb151ab25a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:56.799701 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1187/2410] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:56 2022] DELETE /identity/v3/projects/cdd3ec045bab450dbdc1c797ad612231 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:56.804747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8093a35-cb33-4d9a-bba1-dfe1222c320d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:56.805285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8093a35-cb33-4d9a-bba1-dfe1222c320d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:56.805285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8093a35-cb33-4d9a-bba1-dfe1222c320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:56.826367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f8093a35-cb33-4d9a-bba1-dfe1222c320d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:56.827745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f8093a35-cb33-4d9a-bba1-dfe1222c320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:56.897474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1224/2411] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:56.912235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548950b-19ad-4e99-8caa-59f99bd42ffe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:56.912780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548950b-19ad-4e99-8caa-59f99bd42ffe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:56.912780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548950b-19ad-4e99-8caa-59f99bd42ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:56.939434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b548950b-19ad-4e99-8caa-59f99bd42ffe None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:56.940687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b548950b-19ad-4e99-8caa-59f99bd42ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:56.952380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1188/2412] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:03:56.953655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8093a35-cb33-4d9a-bba1-dfe1222c320d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:56.964844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8093a35-cb33-4d9a-bba1-dfe1222c320d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:56.969493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc8376-da22-4893-ac13-8e563cc130e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:56.970129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc8376-da22-4893-ac13-8e563cc130e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:56.970418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc8376-da22-4893-ac13-8e563cc130e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:56.970699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc8376-da22-4893-ac13-8e563cc130e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:56.971451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc8376-da22-4893-ac13-8e563cc130e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:03:56.971767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc8376-da22-4893-ac13-8e563cc130e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:56.973384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc8376-da22-4893-ac13-8e563cc130e7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:56.986378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1225/2413] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:03:56.990449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548950b-19ad-4e99-8caa-59f99bd42ffe None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:57.000853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548950b-19ad-4e99-8caa-59f99bd42ffe None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:57.006049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8fcf-e42f-470a-82ca-51df36700fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:57.006693 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8fcf-e42f-470a-82ca-51df36700fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:57.006975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8fcf-e42f-470a-82ca-51df36700fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:57.007260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8fcf-e42f-470a-82ca-51df36700fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:57.007919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae8fcf-e42f-470a-82ca-51df36700fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:57.009848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae8fcf-e42f-470a-82ca-51df36700fa1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:57.103663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1189/2414] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:03:56 2022] POST /identity/v3/projects => generated 397 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:57.108293 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc8376-da22-4893-ac13-8e563cc130e7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:57.118708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc8376-da22-4893-ac13-8e563cc130e7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:57.180459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:57.187350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c0cd-1a40-47b3-bb54-5e996d24508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:57.187963 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c0cd-1a40-47b3-bb54-5e996d24508e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:57.188232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c0cd-1a40-47b3-bb54-5e996d24508e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:57.188505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303c0cd-1a40-47b3-bb54-5e996d24508e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:57.189261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303c0cd-1a40-47b3-bb54-5e996d24508e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:57.191240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303c0cd-1a40-47b3-bb54-5e996d24508e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:57.289989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1226/2415] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:03:57 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:03:57.292290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8fcf-e42f-470a-82ca-51df36700fa1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:57.307826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8fcf-e42f-470a-82ca-51df36700fa1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:57.314000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7d00f-688b-4529-878f-48bca8f86e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:57.314918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7d00f-688b-4529-878f-48bca8f86e4b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:57.314918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7d00f-688b-4529-878f-48bca8f86e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:57.315189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7d00f-688b-4529-878f-48bca8f86e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:57.315972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7d00f-688b-4529-878f-48bca8f86e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:57.317606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7d00f-688b-4529-878f-48bca8f86e4b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:57.329206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1190/2416] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:57.333334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c0cd-1a40-47b3-bb54-5e996d24508e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:57.346021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303c0cd-1a40-47b3-bb54-5e996d24508e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:57.351156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bcca8-8494-4b56-a3b3-f3a3f9bc3569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:57.351818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bcca8-8494-4b56-a3b3-f3a3f9bc3569 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:57.352226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bcca8-8494-4b56-a3b3-f3a3f9bc3569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:57.352500 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bcca8-8494-4b56-a3b3-f3a3f9bc3569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:57.353236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bcca8-8494-4b56-a3b3-f3a3f9bc3569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:57.355324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bcca8-8494-4b56-a3b3-f3a3f9bc3569 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:57.367784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1227/2417] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:03:57.371736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7d00f-688b-4529-878f-48bca8f86e4b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:57.382301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7d00f-688b-4529-878f-48bca8f86e4b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:57.389579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad510-cebb-4d28-ada6-dc6394dd5a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:57.389579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad510-cebb-4d28-ada6-dc6394dd5a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:57.389579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad510-cebb-4d28-ada6-dc6394dd5a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:57.389579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad510-cebb-4d28-ada6-dc6394dd5a4a admin admin] PATH_INFO: `/v3/projects/d039ae88d16544eba47eee378c4141ac/users/8805e8d804964109a84905e47ae1052f/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:57.410671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dad510-cebb-4d28-ada6-dc6394dd5a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d039ae88d16544eba47eee378c4141ac, user_id=8805e8d804964109a84905e47ae1052f, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:57.413408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dad510-cebb-4d28-ada6-dc6394dd5a4a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:57.481868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1191/2418] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:03:57 2022] PUT /identity/v3/projects/d039ae88d16544eba47eee378c4141ac/users/8805e8d804964109a84905e47ae1052f/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:03:57.492362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143afdb8-b0c5-4daa-a29f-bcbd9e8cf656 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:57.493013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143afdb8-b0c5-4daa-a29f-bcbd9e8cf656 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:57.493302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143afdb8-b0c5-4daa-a29f-bcbd9e8cf656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:57.522879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-143afdb8-b0c5-4daa-a29f-bcbd9e8cf656 None None] MFA Rules not processed for user `8805e8d804964109a84905e47ae1052f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:03:57.524130 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-143afdb8-b0c5-4daa-a29f-bcbd9e8cf656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:57.591998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1228/2419] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:03:57.604412 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad510-cebb-4d28-ada6-dc6394dd5a4a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:57.606258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-53dad510-cebb-4d28-ada6-dc6394dd5a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:57.669566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad510-cebb-4d28-ada6-dc6394dd5a4a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:57.673986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86015d6-2a02-4e64-9495-1999ca41a1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:57.674627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86015d6-2a02-4e64-9495-1999ca41a1ce service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:57.674913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86015d6-2a02-4e64-9495-1999ca41a1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:57.675192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86015d6-2a02-4e64-9495-1999ca41a1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:57.684721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86015d6-2a02-4e64-9495-1999ca41a1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:57.686454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86015d6-2a02-4e64-9495-1999ca41a1ce service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:57.698360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1192/2420] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:00.981292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a03d9-d47f-4b8c-a26b-e5976ed6f3f3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:00.981794 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a03d9-d47f-4b8c-a26b-e5976ed6f3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:00.981890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a03d9-d47f-4b8c-a26b-e5976ed6f3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:01.000576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-375a03d9-d47f-4b8c-a26b-e5976ed6f3f3 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:01.001759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-375a03d9-d47f-4b8c-a26b-e5976ed6f3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:01.057053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1229/2421] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:04:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:01.070332 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86015d6-2a02-4e64-9495-1999ca41a1ce service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:01.071799 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a86015d6-2a02-4e64-9495-1999ca41a1ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:01.083742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:01.145039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86015d6-2a02-4e64-9495-1999ca41a1ce service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:01.151680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a19b4-cf4d-43d0-9e6a-f81a3810fb54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:01.152290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a19b4-cf4d-43d0-9e6a-f81a3810fb54 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:01.152662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a19b4-cf4d-43d0-9e6a-f81a3810fb54 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:01.152937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a19b4-cf4d-43d0-9e6a-f81a3810fb54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:01.165320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a19b4-cf4d-43d0-9e6a-f81a3810fb54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:01.165320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a19b4-cf4d-43d0-9e6a-f81a3810fb54 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:01.171479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1193/2422] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:04:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:04:02.005826 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af295c6-18b2-4db3-addb-5ae3b5ca3e94 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:02.006351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af295c6-18b2-4db3-addb-5ae3b5ca3e94 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:02.006448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af295c6-18b2-4db3-addb-5ae3b5ca3e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:02.027481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3af295c6-18b2-4db3-addb-5ae3b5ca3e94 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:02.028687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3af295c6-18b2-4db3-addb-5ae3b5ca3e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:02.035798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1230/2423] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:02.050786 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a19b4-cf4d-43d0-9e6a-f81a3810fb54 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:02.061687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a19b4-cf4d-43d0-9e6a-f81a3810fb54 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:02.069895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec5022-da87-40a9-bcf0-1155909d915a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:02.070549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5022-da87-40a9-bcf0-1155909d915a service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:02.073438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5022-da87-40a9-bcf0-1155909d915a service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:02.073438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec5022-da87-40a9-bcf0-1155909d915a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:02.080150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5022-da87-40a9-bcf0-1155909d915a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:02.081800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec5022-da87-40a9-bcf0-1155909d915a service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:02.090575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1194/2424] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:04:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:04:03.182784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f26449-12a2-4616-9c02-a4bbb31418e5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:03.183274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f26449-12a2-4616-9c02-a4bbb31418e5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:03.183996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f26449-12a2-4616-9c02-a4bbb31418e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:03.203952 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-57f26449-12a2-4616-9c02-a4bbb31418e5 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:03.205127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-57f26449-12a2-4616-9c02-a4bbb31418e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:03.215782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1231/2425] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 09:04:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:03.231205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec5022-da87-40a9-bcf0-1155909d915a service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:03.241812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec5022-da87-40a9-bcf0-1155909d915a service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:03.248047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac556efa-b4ea-4084-a4fc-d097547bcd09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:03.248680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac556efa-b4ea-4084-a4fc-d097547bcd09 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:03.248964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac556efa-b4ea-4084-a4fc-d097547bcd09 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:03.249241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac556efa-b4ea-4084-a4fc-d097547bcd09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:03.257694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac556efa-b4ea-4084-a4fc-d097547bcd09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:03.259357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac556efa-b4ea-4084-a4fc-d097547bcd09 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:03.267473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1195/2426] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:04:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:04:03.603165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f26449-12a2-4616-9c02-a4bbb31418e5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:03.671153 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:03.676875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f26449-12a2-4616-9c02-a4bbb31418e5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:03.681530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:03.682194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:03.682516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:03.682797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] PATH_INFO: `/v3/users/8805e8d804964109a84905e47ae1052f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:03.683967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8805e8d804964109a84905e47ae1052f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:03.685890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:03.911976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8805e8d804964109a84905e47ae1052f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:03.912676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8805e8d804964109a84905e47ae1052f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:03.920592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8805e8d804964109a84905e47ae1052f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:03.998432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8805e8d804964109a84905e47ae1052f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:03.998564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2dd73-d3dc-4fbf-8c25-bfddd0e36fda None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:03.998860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2dd73-d3dc-4fbf-8c25-bfddd0e36fda None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:03.999140 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2dd73-d3dc-4fbf-8c25-bfddd0e36fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:03.999279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-65f3d5da-2602-448e-855f-9373fe7e2273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8805e8d804964109a84905e47ae1052f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:04.018436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1232/2427] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:04:03 2022] DELETE /identity/v3/users/8805e8d804964109a84905e47ae1052f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:04.019016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a6d2dd73-d3dc-4fbf-8c25-bfddd0e36fda None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:04.020229 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a6d2dd73-d3dc-4fbf-8c25-bfddd0e36fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:04.022825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504ee7-a684-4166-9b57-7bc1ef26bf31 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:04.023182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504ee7-a684-4166-9b57-7bc1ef26bf31 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:04.023461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66504ee7-a684-4166-9b57-7bc1ef26bf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:04.043622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-66504ee7-a684-4166-9b57-7bc1ef26bf31 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:04.044833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66504ee7-a684-4166-9b57-7bc1ef26bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:04.081217 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1196/2428] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:04:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:04:04.093645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2dd73-d3dc-4fbf-8c25-bfddd0e36fda None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:04.095084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a6d2dd73-d3dc-4fbf-8c25-bfddd0e36fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:04.109583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1233/2429] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:04:04.119092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66504ee7-a684-4166-9b57-7bc1ef26bf31 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:04.120434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66504ee7-a684-4166-9b57-7bc1ef26bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:04.163777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2dd73-d3dc-4fbf-8c25-bfddd0e36fda None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:04.169199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4783f9-245c-4af5-beb6-27a0741261ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:04.169809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4783f9-245c-4af5-beb6-27a0741261ed service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:04.170131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4783f9-245c-4af5-beb6-27a0741261ed service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:04.170413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4783f9-245c-4af5-beb6-27a0741261ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:04.178789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4783f9-245c-4af5-beb6-27a0741261ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:04.179161 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66504ee7-a684-4166-9b57-7bc1ef26bf31 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:04.180381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4783f9-245c-4af5-beb6-27a0741261ed service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:04.182792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a8be9-a5ab-44c8-9d20-bff93f9b4323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:04.183896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a8be9-a5ab-44c8-9d20-bff93f9b4323 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:04.184310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a8be9-a5ab-44c8-9d20-bff93f9b4323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:04.184479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a8be9-a5ab-44c8-9d20-bff93f9b4323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:04.188873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1197/2430] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:04:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 09:04:04.205294 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a8be9-a5ab-44c8-9d20-bff93f9b4323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:04.207127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a8be9-a5ab-44c8-9d20-bff93f9b4323 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:04.217548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1234/2431] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:04:04.723753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4783f9-245c-4af5-beb6-27a0741261ed service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:04.727794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bf4783f9-245c-4af5-beb6-27a0741261ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:04.748317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4783f9-245c-4af5-beb6-27a0741261ed service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:04.755952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:04.756807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:04.757661 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:04.758209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] PATH_INFO: `/v3/projects/d039ae88d16544eba47eee378c4141ac` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:04.759609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d039ae88d16544eba47eee378c4141ac)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:04.763651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:04.768201 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:04.795494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858fc5c-5ece-4d7b-be11-c79d7dfd02a1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:04.796021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858fc5c-5ece-4d7b-be11-c79d7dfd02a1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:04.796499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858fc5c-5ece-4d7b-be11-c79d7dfd02a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:04.818472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d858fc5c-5ece-4d7b-be11-c79d7dfd02a1 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:04.819697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d858fc5c-5ece-4d7b-be11-c79d7dfd02a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:04.827110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1235/2432] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 09:04:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:04:04.840275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858fc5c-5ece-4d7b-be11-c79d7dfd02a1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:04.852556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858fc5c-5ece-4d7b-be11-c79d7dfd02a1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:04.858761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc84b-209e-4ec9-b5c6-38e8f0c74b61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:04.859311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc84b-209e-4ec9-b5c6-38e8f0c74b61 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:04.859596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc84b-209e-4ec9-b5c6-38e8f0c74b61 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:04.859892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc84b-209e-4ec9-b5c6-38e8f0c74b61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:04.868572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc84b-209e-4ec9-b5c6-38e8f0c74b61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:04.870201 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc84b-209e-4ec9-b5c6-38e8f0c74b61 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:04.873151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd039ae88d16544eba47eee378c4141ac', 'request_id': 'req-8620f659-9aa5-4d38-8295-24c39b2e4538'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:04.874112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:04.879641 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1236/2433] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:04:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 09:04:04.888148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd039ae88d16544eba47eee378c4141ac', 'request_id': 'req-8620f659-9aa5-4d38-8295-24c39b2e4538'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:04.898624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd039ae88d16544eba47eee378c4141ac', 'request_id': 'req-8620f659-9aa5-4d38-8295-24c39b2e4538'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:04.975689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] The token cache is being invalidate because project d039ae88d16544eba47eee378c4141ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:04:04.975989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:04.980704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:04.980704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1198/2434] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:04:04 2022] DELETE /identity/v3/projects/d039ae88d16544eba47eee378c4141ac => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:05.075265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc84b-209e-4ec9-b5c6-38e8f0c74b61 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:05.076870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bd2fc84b-209e-4ec9-b5c6-38e8f0c74b61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:05.100927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc84b-209e-4ec9-b5c6-38e8f0c74b61 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:05.187250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:05.187891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:05.188172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:05.188449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] PATH_INFO: `/v3/users/2003f3fec37d4320bb511e33212de018` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:05.189614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2003f3fec37d4320bb511e33212de018)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:05.195859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:05.407890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2003f3fec37d4320bb511e33212de018'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:05.409310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2003f3fec37d4320bb511e33212de018'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:05.423976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2003f3fec37d4320bb511e33212de018'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:05.478270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2003f3fec37d4320bb511e33212de018'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:05.478922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bcdc50f4-2a17-47a7-b062-626358f40058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2003f3fec37d4320bb511e33212de018'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:05.499157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1237/2435] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:04:05 2022] DELETE /identity/v3/users/2003f3fec37d4320bb511e33212de018 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:05.750183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:05.753415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:05.790653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620f659-9aa5-4d38-8295-24c39b2e4538 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:05.854151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:05.854712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:05.855043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:05.855296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] PATH_INFO: `/v3/projects/5b31e2069a06417a83615c4c3565b186` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:05.856429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b31e2069a06417a83615c4c3565b186)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:05.858372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:05.959091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b31e2069a06417a83615c4c3565b186', 'request_id': 'req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:05.967137 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b31e2069a06417a83615c4c3565b186', 'request_id': 'req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:05.974555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b31e2069a06417a83615c4c3565b186', 'request_id': 'req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:06.027607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] The token cache is being invalidate because project 5b31e2069a06417a83615c4c3565b186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:04:06.033169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:06.033169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-aced47a2-f4cc-4eb3-98e5-24d60d57d34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:06.033169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1199/2436] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:04:05 2022] DELETE /identity/v3/projects/5b31e2069a06417a83615c4c3565b186 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:06.036887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ac941-223c-456a-ae7b-9df5f5c73a50 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.037266 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ac941-223c-456a-ae7b-9df5f5c73a50 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.037560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ac941-223c-456a-ae7b-9df5f5c73a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.060102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-032ac941-223c-456a-ae7b-9df5f5c73a50 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:06.061309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-032ac941-223c-456a-ae7b-9df5f5c73a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:06.122582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1238/2437] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:06.132112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab93d2-d619-4c0f-9765-7d816d4c28d1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.132405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab93d2-d619-4c0f-9765-7d816d4c28d1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.132681 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab93d2-d619-4c0f-9765-7d816d4c28d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.152580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-efab93d2-d619-4c0f-9765-7d816d4c28d1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:06.153824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-efab93d2-d619-4c0f-9765-7d816d4c28d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:06.162046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1200/2438] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:06.168038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ac941-223c-456a-ae7b-9df5f5c73a50 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:06.177821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ac941-223c-456a-ae7b-9df5f5c73a50 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:06.182631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dc5cd-03db-4b4d-beb3-627a5e922ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:06.183893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc5cd-03db-4b4d-beb3-627a5e922ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.184188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc5cd-03db-4b4d-beb3-627a5e922ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.184461 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc5cd-03db-4b4d-beb3-627a5e922ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.185142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dc5cd-03db-4b4d-beb3-627a5e922ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:04:06.185536 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dc5cd-03db-4b4d-beb3-627a5e922ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:06.187089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dc5cd-03db-4b4d-beb3-627a5e922ca7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:06.199028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1239/2439] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:04:06.209118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab93d2-d619-4c0f-9765-7d816d4c28d1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:06.223341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab93d2-d619-4c0f-9765-7d816d4c28d1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:06.227481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba97131-6922-4dbc-be87-c61487dfa987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:06.228303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba97131-6922-4dbc-be87-c61487dfa987 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.228592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba97131-6922-4dbc-be87-c61487dfa987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.228869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba97131-6922-4dbc-be87-c61487dfa987 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.229594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba97131-6922-4dbc-be87-c61487dfa987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:06.232199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba97131-6922-4dbc-be87-c61487dfa987 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:06.246831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:06.358474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1201/2440] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:04:06 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:04:06.362420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dc5cd-03db-4b4d-beb3-627a5e922ca7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:06.371279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:06.375403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dc5cd-03db-4b4d-beb3-627a5e922ca7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:06.449819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0d0a-503e-45a5-aa6a-6484b392a1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:06.450469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0d0a-503e-45a5-aa6a-6484b392a1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.450749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0d0a-503e-45a5-aa6a-6484b392a1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.451026 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0d0a-503e-45a5-aa6a-6484b392a1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.451669 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f0d0a-503e-45a5-aa6a-6484b392a1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:06.453592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f0d0a-503e-45a5-aa6a-6484b392a1e8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:06.564422 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1240/2441] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:04:06 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:04:06.572001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba97131-6922-4dbc-be87-c61487dfa987 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:06.582414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba97131-6922-4dbc-be87-c61487dfa987 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:06.587098 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ecd90-d0da-45ea-87d8-189e3cdf83ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:06.587695 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ecd90-d0da-45ea-87d8-189e3cdf83ca admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.587977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ecd90-d0da-45ea-87d8-189e3cdf83ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.588250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ecd90-d0da-45ea-87d8-189e3cdf83ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.588895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ecd90-d0da-45ea-87d8-189e3cdf83ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:06.591050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ecd90-d0da-45ea-87d8-189e3cdf83ca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:06.600881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1202/2442] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:04:06.604728 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0d0a-503e-45a5-aa6a-6484b392a1e8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:06.615583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0d0a-503e-45a5-aa6a-6484b392a1e8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:06.620150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f679b-e4bc-4216-8496-6e863e9a194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:06.620767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f679b-e4bc-4216-8496-6e863e9a194f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.621094 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f679b-e4bc-4216-8496-6e863e9a194f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.625306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f679b-e4bc-4216-8496-6e863e9a194f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.625306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f679b-e4bc-4216-8496-6e863e9a194f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:06.625306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f679b-e4bc-4216-8496-6e863e9a194f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:06.633292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1241/2443] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:04:06.637319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ecd90-d0da-45ea-87d8-189e3cdf83ca admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:06.653563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ecd90-d0da-45ea-87d8-189e3cdf83ca admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:06.653563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13853-89e7-4690-972c-6402e82e3439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:06.653775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13853-89e7-4690-972c-6402e82e3439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.653973 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13853-89e7-4690-972c-6402e82e3439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.654330 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c13853-89e7-4690-972c-6402e82e3439 admin admin] PATH_INFO: `/v3/projects/c530c840988845c68518e005c05986c4/users/661a9009418a4889b0bf6720faae01fb/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.670534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c13853-89e7-4690-972c-6402e82e3439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c530c840988845c68518e005c05986c4, user_id=661a9009418a4889b0bf6720faae01fb, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:06.673291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c13853-89e7-4690-972c-6402e82e3439 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:06.770523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1203/2444] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:04:06 2022] PUT /identity/v3/projects/c530c840988845c68518e005c05986c4/users/661a9009418a4889b0bf6720faae01fb/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:04:06.781442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b4db9-fb38-49c7-9f25-f51f784c728b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.781728 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b4db9-fb38-49c7-9f25-f51f784c728b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.781999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b4db9-fb38-49c7-9f25-f51f784c728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.811861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3b9b4db9-fb38-49c7-9f25-f51f784c728b None None] MFA Rules not processed for user `661a9009418a4889b0bf6720faae01fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:06.813071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3b9b4db9-fb38-49c7-9f25-f51f784c728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:06.887561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1242/2445] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:04:06.899871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13853-89e7-4690-972c-6402e82e3439 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:06.902451 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-26c13853-89e7-4690-972c-6402e82e3439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:06.962300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c13853-89e7-4690-972c-6402e82e3439 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:06.966890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f7b32-7436-410c-9c32-76bbd7b73490 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8339b6461e4e28bc397dcd3f85e1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:06.967518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f7b32-7436-410c-9c32-76bbd7b73490 service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:06.967800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f7b32-7436-410c-9c32-76bbd7b73490 service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:06.968074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f7b32-7436-410c-9c32-76bbd7b73490 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:06.977800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f7b32-7436-410c-9c32-76bbd7b73490 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:06.977997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f7b32-7436-410c-9c32-76bbd7b73490 service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:06.987976 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1204/2446] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:07.731767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b4db9-fb38-49c7-9f25-f51f784c728b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:07.733257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3b9b4db9-fb38-49c7-9f25-f51f784c728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:07.804851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b4db9-fb38-49c7-9f25-f51f784c728b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:07.809964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:07.810642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:07.810923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:07.811225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] PATH_INFO: `/v3/users/348f6d7099474deab41e92835173f7b4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:07.812358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=348f6d7099474deab41e92835173f7b4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:07.814303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:07.829347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:08.011211 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348f6d7099474deab41e92835173f7b4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.012382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348f6d7099474deab41e92835173f7b4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.020578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348f6d7099474deab41e92835173f7b4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.097049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348f6d7099474deab41e92835173f7b4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.097668 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d8eade4-b270-47ef-9c30-3af69506f61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348f6d7099474deab41e92835173f7b4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.117120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1243/2447] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:04:07 2022] DELETE /identity/v3/users/348f6d7099474deab41e92835173f7b4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:08.121638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56b685-87c1-46c7-a83c-4bbdcacb0121 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:08.122173 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56b685-87c1-46c7-a83c-4bbdcacb0121 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:08.122267 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56b685-87c1-46c7-a83c-4bbdcacb0121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:08.140509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ed856-d7bd-422c-b6b8-85c33718d7d2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:08.141034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ed856-d7bd-422c-b6b8-85c33718d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:08.141342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5b56b685-87c1-46c7-a83c-4bbdcacb0121 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:08.141464 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ed856-d7bd-422c-b6b8-85c33718d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:08.142593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b56b685-87c1-46c7-a83c-4bbdcacb0121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:08.164169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-587ed856-d7bd-422c-b6b8-85c33718d7d2 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:08.165439 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-587ed856-d7bd-422c-b6b8-85c33718d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:08.207491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1205/2448] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:08.218007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56b685-87c1-46c7-a83c-4bbdcacb0121 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:08.219395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b56b685-87c1-46c7-a83c-4bbdcacb0121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:08.224871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1244/2449] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:04:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:04:08.239406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ed856-d7bd-422c-b6b8-85c33718d7d2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:08.240515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-587ed856-d7bd-422c-b6b8-85c33718d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:08.281460 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56b685-87c1-46c7-a83c-4bbdcacb0121 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:08.285212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a88f-73dc-4b61-9211-d87534fc01f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:08.285820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a88f-73dc-4b61-9211-d87534fc01f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:08.286131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a88f-73dc-4b61-9211-d87534fc01f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:08.286458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8a88f-73dc-4b61-9211-d87534fc01f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:08.296615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8a88f-73dc-4b61-9211-d87534fc01f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:08.298049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8a88f-73dc-4b61-9211-d87534fc01f2 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:08.308013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1206/2450] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:04:08.317457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ed856-d7bd-422c-b6b8-85c33718d7d2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:08.322933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3801cdd-3290-41bb-8de5-b2ccd24dfa07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:08.325205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3801cdd-3290-41bb-8de5-b2ccd24dfa07 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:08.325205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3801cdd-3290-41bb-8de5-b2ccd24dfa07 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:08.325205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3801cdd-3290-41bb-8de5-b2ccd24dfa07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:08.333264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3801cdd-3290-41bb-8de5-b2ccd24dfa07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:08.334917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3801cdd-3290-41bb-8de5-b2ccd24dfa07 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:08.344083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1245/2451] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:04:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:04:08.542667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a88f-73dc-4b61-9211-d87534fc01f2 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:08.544222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-39b8a88f-73dc-4b61-9211-d87534fc01f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:08.555483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:08.572413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8a88f-73dc-4b61-9211-d87534fc01f2 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:08.580780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:08.581448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:08.581737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:08.582016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] PATH_INFO: `/v3/projects/dadc62a0f07f44fd8e6383a5c9e349d2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:08.583247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dadc62a0f07f44fd8e6383a5c9e349d2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:08.585452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:08.726402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dadc62a0f07f44fd8e6383a5c9e349d2', 'request_id': 'req-85b58e58-5248-4858-81d9-d93562c06f3b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.733745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dadc62a0f07f44fd8e6383a5c9e349d2', 'request_id': 'req-85b58e58-5248-4858-81d9-d93562c06f3b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.750788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dadc62a0f07f44fd8e6383a5c9e349d2', 'request_id': 'req-85b58e58-5248-4858-81d9-d93562c06f3b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.838066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] The token cache is being invalidate because project dadc62a0f07f44fd8e6383a5c9e349d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:04:08.838458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.847525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:08.847525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1207/2452] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:04:08 2022] DELETE /identity/v3/projects/dadc62a0f07f44fd8e6383a5c9e349d2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:15.534520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ee38-b4a5-46ba-8710-32d60517a119 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:15.535065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ee38-b4a5-46ba-8710-32d60517a119 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:15.535065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ee38-b4a5-46ba-8710-32d60517a119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:15.557825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9cf7ee38-b4a5-46ba-8710-32d60517a119 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:15.559142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9cf7ee38-b4a5-46ba-8710-32d60517a119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:15.584681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:15.639028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1246/2453] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:15.660633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:15.662728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:15.756189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b58e58-5248-4858-81d9-d93562c06f3b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:15.763242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefab56-85c6-4039-bbb2-96228c37637b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:15.764089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefab56-85c6-4039-bbb2-96228c37637b service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:15.764558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefab56-85c6-4039-bbb2-96228c37637b service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:15.765037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefab56-85c6-4039-bbb2-96228c37637b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:15.780735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefab56-85c6-4039-bbb2-96228c37637b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:15.782838 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefab56-85c6-4039-bbb2-96228c37637b service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:15.806435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1208/2454] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:21.843585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44261e-12d6-4e2b-8442-d067022ceba4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:21.844141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44261e-12d6-4e2b-8442-d067022ceba4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:21.844141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44261e-12d6-4e2b-8442-d067022ceba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:21.879418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9e44261e-12d6-4e2b-8442-d067022ceba4 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:21.879418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e44261e-12d6-4e2b-8442-d067022ceba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:21.879418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1247/2455] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:21.891949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefab56-85c6-4039-bbb2-96228c37637b service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:21.893513 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aaefab56-85c6-4039-bbb2-96228c37637b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:21.910008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefab56-85c6-4039-bbb2-96228c37637b service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:21.916843 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9204-5c18-471e-a3ab-415c7689ad47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:21.917459 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9204-5c18-471e-a3ab-415c7689ad47 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:21.917741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9204-5c18-471e-a3ab-415c7689ad47 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:21.918015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9204-5c18-471e-a3ab-415c7689ad47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:21.927579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9204-5c18-471e-a3ab-415c7689ad47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:21.929195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9204-5c18-471e-a3ab-415c7689ad47 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:21.939636 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1209/2456] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:23.548742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44261e-12d6-4e2b-8442-d067022ceba4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:23.550181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e44261e-12d6-4e2b-8442-d067022ceba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:23.586575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9204-5c18-471e-a3ab-415c7689ad47 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:23.588947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6a0d9204-5c18-471e-a3ab-415c7689ad47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:23.630862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44261e-12d6-4e2b-8442-d067022ceba4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:23.636099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311a5de-4615-41ea-93dc-a21d6bb63e45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:23.637446 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311a5de-4615-41ea-93dc-a21d6bb63e45 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:23.637736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311a5de-4615-41ea-93dc-a21d6bb63e45 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:23.638011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311a5de-4615-41ea-93dc-a21d6bb63e45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:23.639859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a311a5de-4615-41ea-93dc-a21d6bb63e45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:23.652470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311a5de-4615-41ea-93dc-a21d6bb63e45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:23.652660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:23.654125 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311a5de-4615-41ea-93dc-a21d6bb63e45 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:23.664724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1248/2457] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:23.669499 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9204-5c18-471e-a3ab-415c7689ad47 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:23.673141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8592ea5-74b7-46af-99f3-639291d6f2ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:23.674034 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8592ea5-74b7-46af-99f3-639291d6f2ff service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:23.674341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8592ea5-74b7-46af-99f3-639291d6f2ff service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:23.674708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8592ea5-74b7-46af-99f3-639291d6f2ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:23.684738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8592ea5-74b7-46af-99f3-639291d6f2ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:23.686368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8592ea5-74b7-46af-99f3-639291d6f2ff service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:23.696635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1210/2458] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:26.185310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173d4c1-5169-4e33-8756-721d27402039 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:26.185764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173d4c1-5169-4e33-8756-721d27402039 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:26.185881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173d4c1-5169-4e33-8756-721d27402039 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:26.187910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1249/2459] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:04:26.196284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede2c9-f445-4981-b609-e5b5c74aeca6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:26.196878 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede2c9-f445-4981-b609-e5b5c74aeca6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:26.197130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede2c9-f445-4981-b609-e5b5c74aeca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:26.226476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bfede2c9-f445-4981-b609-e5b5c74aeca6 None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:26.228145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bfede2c9-f445-4981-b609-e5b5c74aeca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:26.241344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1211/2460] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:04:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:26.256876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173d4c1-5169-4e33-8756-721d27402039 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:26.259920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b173d4c1-5169-4e33-8756-721d27402039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:26.372887 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173d4c1-5169-4e33-8756-721d27402039 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:26.377333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8608-fff8-454c-b8d6-257da4c2369c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8339b6461e4e28bc397dcd3f85e1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:26.378200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8608-fff8-454c-b8d6-257da4c2369c service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:26.378576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8608-fff8-454c-b8d6-257da4c2369c service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:26.379011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8608-fff8-454c-b8d6-257da4c2369c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:26.391998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff8608-fff8-454c-b8d6-257da4c2369c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:26.395416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff8608-fff8-454c-b8d6-257da4c2369c service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:26.407839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1250/2461] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:26.594327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf637d0-29d1-4a88-97a0-0e842c31d06b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:26.594621 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf637d0-29d1-4a88-97a0-0e842c31d06b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:26.594895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf637d0-29d1-4a88-97a0-0e842c31d06b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:26.596236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1212/2462] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:04:26.601447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d123-01be-408f-9749-0de46cd94c88 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:26.601744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d123-01be-408f-9749-0de46cd94c88 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:26.602021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d123-01be-408f-9749-0de46cd94c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:26.622913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3b24d123-01be-408f-9749-0de46cd94c88 None None] MFA Rules not processed for user `e0b66989d4df4398ad723f587cbc24bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:26.624144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3b24d123-01be-408f-9749-0de46cd94c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:26.688674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1251/2463] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:04:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:26.701497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf637d0-29d1-4a88-97a0-0e842c31d06b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:26.703228 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-adf637d0-29d1-4a88-97a0-0e842c31d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:26.716082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf637d0-29d1-4a88-97a0-0e842c31d06b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:26.719583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceec712-7af7-4b3f-8914-3e166b542d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:26.720175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec712-7af7-4b3f-8914-3e166b542d89 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:26.720455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec712-7af7-4b3f-8914-3e166b542d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:26.720730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceec712-7af7-4b3f-8914-3e166b542d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:26.727910 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceec712-7af7-4b3f-8914-3e166b542d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:26.729363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceec712-7af7-4b3f-8914-3e166b542d89 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:26.737566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1213/2464] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:04:26.822152 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed066-7b2e-4caf-acc7-0f1d7d57e130 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:26.822445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed066-7b2e-4caf-acc7-0f1d7d57e130 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:26.822748 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed066-7b2e-4caf-acc7-0f1d7d57e130 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:26.824148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1252/2465] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:04:26.829946 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d93f9-9cde-4d36-8d35-cc81bbff5f2d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:26.830309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d93f9-9cde-4d36-8d35-cc81bbff5f2d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:26.830591 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d93f9-9cde-4d36-8d35-cc81bbff5f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:26.851230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-179d93f9-9cde-4d36-8d35-cc81bbff5f2d None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:26.852441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-179d93f9-9cde-4d36-8d35-cc81bbff5f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:26.862303 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1214/2466] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:04:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:26.873275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed066-7b2e-4caf-acc7-0f1d7d57e130 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:26.875191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0baed066-7b2e-4caf-acc7-0f1d7d57e130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:26.883775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:26.895281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed066-7b2e-4caf-acc7-0f1d7d57e130 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:26.899401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce005e-fb06-48e1-93d6-3a3c87d0595c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:26.900024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce005e-fb06-48e1-93d6-3a3c87d0595c service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:26.900307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce005e-fb06-48e1-93d6-3a3c87d0595c service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:26.900581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce005e-fb06-48e1-93d6-3a3c87d0595c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:26.912583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce005e-fb06-48e1-93d6-3a3c87d0595c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:26.914868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce005e-fb06-48e1-93d6-3a3c87d0595c service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:26.929286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1253/2467] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:27.698329 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5b61d-d8e7-4364-b5a3-db01d6615c47 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:27.698945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5b61d-d8e7-4364-b5a3-db01d6615c47 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:27.698945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5b61d-d8e7-4364-b5a3-db01d6615c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:27.719426 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-03a5b61d-d8e7-4364-b5a3-db01d6615c47 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:27.720625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-03a5b61d-d8e7-4364-b5a3-db01d6615c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:27.732226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1215/2468] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:27.746139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce005e-fb06-48e1-93d6-3a3c87d0595c service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:27.759145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce005e-fb06-48e1-93d6-3a3c87d0595c service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:27.766339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f146d4-da00-4634-83bd-e1176ed14644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:27.766957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f146d4-da00-4634-83bd-e1176ed14644 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:27.767290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f146d4-da00-4634-83bd-e1176ed14644 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:27.767607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f146d4-da00-4634-83bd-e1176ed14644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:27.776455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f146d4-da00-4634-83bd-e1176ed14644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:27.778645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f146d4-da00-4634-83bd-e1176ed14644 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:27.788810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1254/2469] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:30.467213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4bf37-1de2-45c5-8e6c-8f4fc2e9563e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:30.467687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4bf37-1de2-45c5-8e6c-8f4fc2e9563e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:30.467781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4bf37-1de2-45c5-8e6c-8f4fc2e9563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:30.488257 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-59b4bf37-1de2-45c5-8e6c-8f4fc2e9563e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:30.489468 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-59b4bf37-1de2-45c5-8e6c-8f4fc2e9563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:30.497841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1216/2470] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:30.512544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f146d4-da00-4634-83bd-e1176ed14644 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:30.523620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f146d4-da00-4634-83bd-e1176ed14644 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:30.529840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0266c76-edd1-4d87-8bfb-00d871f03f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:30.530454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266c76-edd1-4d87-8bfb-00d871f03f39 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:30.530734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266c76-edd1-4d87-8bfb-00d871f03f39 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:30.531002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266c76-edd1-4d87-8bfb-00d871f03f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:30.539156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0266c76-edd1-4d87-8bfb-00d871f03f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:30.541014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0266c76-edd1-4d87-8bfb-00d871f03f39 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:30.551332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1255/2471] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:33.917967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4bf37-1de2-45c5-8e6c-8f4fc2e9563e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:33.919487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-59b4bf37-1de2-45c5-8e6c-8f4fc2e9563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:33.932822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4bf37-1de2-45c5-8e6c-8f4fc2e9563e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:33.938731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:33.939813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:33.940182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:33.941052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] PATH_INFO: `/v3/users/661a9009418a4889b0bf6720faae01fb` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:33.941862 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661a9009418a4889b0bf6720faae01fb)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:33.943840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:34.080676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661a9009418a4889b0bf6720faae01fb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:34.081677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661a9009418a4889b0bf6720faae01fb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:34.089284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661a9009418a4889b0bf6720faae01fb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:34.089971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661a9009418a4889b0bf6720faae01fb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:34.102579 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661a9009418a4889b0bf6720faae01fb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:34.175380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1217/2472] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:04:33 2022] DELETE /identity/v3/users/661a9009418a4889b0bf6720faae01fb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:34.179967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84caf47-b636-4858-8311-a1c30ea934ab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:34.180506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84caf47-b636-4858-8311-a1c30ea934ab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:34.180506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84caf47-b636-4858-8311-a1c30ea934ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:34.201757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f84caf47-b636-4858-8311-a1c30ea934ab None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:34.203015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f84caf47-b636-4858-8311-a1c30ea934ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:34.264573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1256/2473] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:04:34.274428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:34.275872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:34.341312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252996e-aece-430a-b168-f88e741d9e32 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:34.345058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac079795-de55-4060-bc07-fe30ff62f4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:34.345673 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079795-de55-4060-bc07-fe30ff62f4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:34.345951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079795-de55-4060-bc07-fe30ff62f4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:34.346254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079795-de55-4060-bc07-fe30ff62f4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:34.356618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac079795-de55-4060-bc07-fe30ff62f4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:34.358241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac079795-de55-4060-bc07-fe30ff62f4f9 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:34.368150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1218/2474] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:34.704022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8315f-4ab8-4675-b94d-55d8df68e4c4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:34.704311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8315f-4ab8-4675-b94d-55d8df68e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:34.704874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8315f-4ab8-4675-b94d-55d8df68e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:34.725183 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-49a8315f-4ab8-4675-b94d-55d8df68e4c4 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:34.726593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49a8315f-4ab8-4675-b94d-55d8df68e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:34.805245 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1257/2475] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:34.829505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac079795-de55-4060-bc07-fe30ff62f4f9 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:34.829505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ac079795-de55-4060-bc07-fe30ff62f4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:34.864063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8315f-4ab8-4675-b94d-55d8df68e4c4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:34.864280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:34.864389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49a8315f-4ab8-4675-b94d-55d8df68e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:34.892722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8315f-4ab8-4675-b94d-55d8df68e4c4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:34.899210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:34.899829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:34.900227 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:34.900691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] PATH_INFO: `/v3/projects/c530c840988845c68518e005c05986c4` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:34.901908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c530c840988845c68518e005c05986c4)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:34.904581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:34.918275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac079795-de55-4060-bc07-fe30ff62f4f9 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:34.924632 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6738ee-abc3-4fe3-9bae-0c98929e7dd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:34.925587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6738ee-abc3-4fe3-9bae-0c98929e7dd0 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:34.925971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6738ee-abc3-4fe3-9bae-0c98929e7dd0 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:34.926431 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6738ee-abc3-4fe3-9bae-0c98929e7dd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:34.942731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6738ee-abc3-4fe3-9bae-0c98929e7dd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:34.944455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6738ee-abc3-4fe3-9bae-0c98929e7dd0 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:34.953360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1219/2476] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:04:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 09:04:35.064611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c530c840988845c68518e005c05986c4', 'request_id': 'req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:35.068946 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c530c840988845c68518e005c05986c4', 'request_id': 'req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:35.157683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c530c840988845c68518e005c05986c4', 'request_id': 'req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:35.163566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:35.181454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] The token cache is being invalidate because project c530c840988845c68518e005c05986c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:04:35.182233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:35.183945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b1431ef3-1cf8-4c8f-bbd0-3ae00be9c1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:04:35.187796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1258/2477] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:04:34 2022] DELETE /identity/v3/projects/c530c840988845c68518e005c05986c4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:35.193931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f1c7-a069-4fd6-9328-40df46bcb9b5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:35.194252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f1c7-a069-4fd6-9328-40df46bcb9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:35.194642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f1c7-a069-4fd6-9328-40df46bcb9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:35.239084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6f79f1c7-a069-4fd6-9328-40df46bcb9b5 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:35.239084 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6f79f1c7-a069-4fd6-9328-40df46bcb9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:35.391559 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1220/2478] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:35.394334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f38523-a252-417f-acbb-fdf0eca0e00f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:35.394933 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f38523-a252-417f-acbb-fdf0eca0e00f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:35.395213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f38523-a252-417f-acbb-fdf0eca0e00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:35.428904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-11f38523-a252-417f-acbb-fdf0eca0e00f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:35.430301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-11f38523-a252-417f-acbb-fdf0eca0e00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:35.440497 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1259/2479] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:35.445133 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f1c7-a069-4fd6-9328-40df46bcb9b5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:35.455971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f1c7-a069-4fd6-9328-40df46bcb9b5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:35.472379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1e0e5-c0a0-4d8e-9df1-3f3816bee3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:35.473131 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1e0e5-c0a0-4d8e-9df1-3f3816bee3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:35.473467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1e0e5-c0a0-4d8e-9df1-3f3816bee3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:35.473819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1e0e5-c0a0-4d8e-9df1-3f3816bee3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:35.474685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1e0e5-c0a0-4d8e-9df1-3f3816bee3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:04:35.475214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1e0e5-c0a0-4d8e-9df1-3f3816bee3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:35.476987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1e0e5-c0a0-4d8e-9df1-3f3816bee3d8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:35.506951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1221/2480] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:04:35.511053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f38523-a252-417f-acbb-fdf0eca0e00f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:35.531297 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f38523-a252-417f-acbb-fdf0eca0e00f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:35.542054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedb37d-8369-44e0-826c-f418420ff539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:35.544257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb37d-8369-44e0-826c-f418420ff539 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:35.545017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb37d-8369-44e0-826c-f418420ff539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:35.545730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb37d-8369-44e0-826c-f418420ff539 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:35.547060 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedb37d-8369-44e0-826c-f418420ff539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:35.551309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedb37d-8369-44e0-826c-f418420ff539 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:35.679635 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1260/2481] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:04:35 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:04:35.683524 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1e0e5-c0a0-4d8e-9df1-3f3816bee3d8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:35.706013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1e0e5-c0a0-4d8e-9df1-3f3816bee3d8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:35.780105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812ef91-57d9-4a85-bfba-b829c5ddffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:35.782156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812ef91-57d9-4a85-bfba-b829c5ddffc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:35.783915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812ef91-57d9-4a85-bfba-b829c5ddffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:35.785494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812ef91-57d9-4a85-bfba-b829c5ddffc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:35.787205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812ef91-57d9-4a85-bfba-b829c5ddffc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:35.791913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812ef91-57d9-4a85-bfba-b829c5ddffc4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:35.851903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56906b0f-2b81-4136-b0df-3a32b3d39df7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:35.854032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56906b0f-2b81-4136-b0df-3a32b3d39df7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:35.854032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56906b0f-2b81-4136-b0df-3a32b3d39df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:35.925387 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-56906b0f-2b81-4136-b0df-3a32b3d39df7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:35.933604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-56906b0f-2b81-4136-b0df-3a32b3d39df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:35.938411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1222/2482] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:04:35 2022] POST /identity/v3/users => generated 287 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:04:35.942852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812ef91-57d9-4a85-bfba-b829c5ddffc4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:35.983035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1261/2483] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:35.992294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812ef91-57d9-4a85-bfba-b829c5ddffc4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:36.001543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339340d1-7c75-4576-a092-913a7834f342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:36.002803 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339340d1-7c75-4576-a092-913a7834f342 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:36.003310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339340d1-7c75-4576-a092-913a7834f342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:36.003770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339340d1-7c75-4576-a092-913a7834f342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:36.009147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339340d1-7c75-4576-a092-913a7834f342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:36.009147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339340d1-7c75-4576-a092-913a7834f342 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:36.010391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56906b0f-2b81-4136-b0df-3a32b3d39df7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:36.012000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-56906b0f-2b81-4136-b0df-3a32b3d39df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:36.042443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1223/2484] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:04:36.049560 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339340d1-7c75-4576-a092-913a7834f342 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:36.069050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339340d1-7c75-4576-a092-913a7834f342 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:36.106359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c600-ff11-431b-86f8-05246d6bec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:36.106997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c600-ff11-431b-86f8-05246d6bec35 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:36.109236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c600-ff11-431b-86f8-05246d6bec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:36.109539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c600-ff11-431b-86f8-05246d6bec35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:36.110845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22c600-ff11-431b-86f8-05246d6bec35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:36.112957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22c600-ff11-431b-86f8-05246d6bec35 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:36.126922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1224/2485] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:04:36.139337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c600-ff11-431b-86f8-05246d6bec35 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:36.154754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c600-ff11-431b-86f8-05246d6bec35 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:36.162692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ce52-791b-4e04-b182-5a0a7d2ef8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:36.163697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ce52-791b-4e04-b182-5a0a7d2ef8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:36.164231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ce52-791b-4e04-b182-5a0a7d2ef8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:36.164669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ce52-791b-4e04-b182-5a0a7d2ef8d4 admin admin] PATH_INFO: `/v3/projects/bb911e65e7d94f318dac927aaceae043/users/f4add54c17a64e27a2e2a385f867fc1d/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:36.169021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:36.185206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56906b0f-2b81-4136-b0df-3a32b3d39df7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:36.186339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ce52-791b-4e04-b182-5a0a7d2ef8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb911e65e7d94f318dac927aaceae043, user_id=f4add54c17a64e27a2e2a385f867fc1d, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:36.191309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ce52-791b-4e04-b182-5a0a7d2ef8d4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:36.191477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cf0a1-d3b3-4683-a89f-6c5d62253f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:36.192244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf0a1-d3b3-4683-a89f-6c5d62253f9f service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:36.192689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf0a1-d3b3-4683-a89f-6c5d62253f9f service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:36.193032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cf0a1-d3b3-4683-a89f-6c5d62253f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:36.204894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cf0a1-d3b3-4683-a89f-6c5d62253f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:36.206667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cf0a1-d3b3-4683-a89f-6c5d62253f9f service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:36.230293 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1262/2486] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:36.283802 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1225/2487] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:04:36 2022] PUT /identity/v3/projects/bb911e65e7d94f318dac927aaceae043/users/f4add54c17a64e27a2e2a385f867fc1d/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:36.288993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d03c7-8c75-486e-a65e-4a8362f5e5ab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:36.289467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d03c7-8c75-486e-a65e-4a8362f5e5ab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:36.289746 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d03c7-8c75-486e-a65e-4a8362f5e5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:36.312790 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a01d03c7-8c75-486e-a65e-4a8362f5e5ab None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:36.314185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a01d03c7-8c75-486e-a65e-4a8362f5e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:36.379349 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1263/2488] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:36.391433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ce52-791b-4e04-b182-5a0a7d2ef8d4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:36.393564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b466ce52-791b-4e04-b182-5a0a7d2ef8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:36.488855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ce52-791b-4e04-b182-5a0a7d2ef8d4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:36.493241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592a64-a76e-4cba-8b5d-72474620e0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:36.494044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592a64-a76e-4cba-8b5d-72474620e0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:36.494512 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592a64-a76e-4cba-8b5d-72474620e0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:36.494886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592a64-a76e-4cba-8b5d-72474620e0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:36.506359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f592a64-a76e-4cba-8b5d-72474620e0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:36.507894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f592a64-a76e-4cba-8b5d-72474620e0f2 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:36.523442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1226/2489] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:44.053742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a8297-d4f6-4be7-9026-153d6758e912 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:44.054488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a8297-d4f6-4be7-9026-153d6758e912 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:44.054488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a8297-d4f6-4be7-9026-153d6758e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:44.088632 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-196a8297-d4f6-4be7-9026-153d6758e912 None None] MFA Rules not processed for user `f4add54c17a64e27a2e2a385f867fc1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:44.089974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-196a8297-d4f6-4be7-9026-153d6758e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:44.127350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:44.171380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1264/2490] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:44.176011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592a64-a76e-4cba-8b5d-72474620e0f2 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:44.187458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592a64-a76e-4cba-8b5d-72474620e0f2 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:44.192429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc569d-e0c8-401d-8cce-2b74eca7d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:44.193058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc569d-e0c8-401d-8cce-2b74eca7d41e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:44.193344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc569d-e0c8-401d-8cce-2b74eca7d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:44.193625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc569d-e0c8-401d-8cce-2b74eca7d41e admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:44.194335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc569d-e0c8-401d-8cce-2b74eca7d41e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:44.196281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc569d-e0c8-401d-8cce-2b74eca7d41e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:44.318516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1227/2491] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:04:44 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:04:44.322765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a8297-d4f6-4be7-9026-153d6758e912 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:44.334317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a8297-d4f6-4be7-9026-153d6758e912 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:44.396142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682f3ce-78fa-42bc-a0e5-9de1598c6c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:44.396758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682f3ce-78fa-42bc-a0e5-9de1598c6c8b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:44.397039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682f3ce-78fa-42bc-a0e5-9de1598c6c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:44.397312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682f3ce-78fa-42bc-a0e5-9de1598c6c8b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:44.397959 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682f3ce-78fa-42bc-a0e5-9de1598c6c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:44.399961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682f3ce-78fa-42bc-a0e5-9de1598c6c8b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:44.471870 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1265/2492] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:04:44 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:04:44.475893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc569d-e0c8-401d-8cce-2b74eca7d41e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:44.487152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc569d-e0c8-401d-8cce-2b74eca7d41e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:44.491894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32194af5-2d74-4f1c-9c62-1838ad4d70d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:44.492549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194af5-2d74-4f1c-9c62-1838ad4d70d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:44.492837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194af5-2d74-4f1c-9c62-1838ad4d70d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:44.493117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32194af5-2d74-4f1c-9c62-1838ad4d70d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:44.493771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32194af5-2d74-4f1c-9c62-1838ad4d70d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:44.495450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32194af5-2d74-4f1c-9c62-1838ad4d70d9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:44.507594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1228/2493] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:04:44.511903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682f3ce-78fa-42bc-a0e5-9de1598c6c8b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:44.523090 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682f3ce-78fa-42bc-a0e5-9de1598c6c8b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:44.528270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecc1e1-b1da-43e5-b0b6-397f63c72954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:44.528918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecc1e1-b1da-43e5-b0b6-397f63c72954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:44.529214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecc1e1-b1da-43e5-b0b6-397f63c72954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:44.529489 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecc1e1-b1da-43e5-b0b6-397f63c72954 admin admin] PATH_INFO: `/v3/projects/df0df9990a1d461ca0e7bb46f4d74b70/users/4d88bd3cd6ce43e1a458bcfe29e1b59e/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:44.545146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecc1e1-b1da-43e5-b0b6-397f63c72954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0df9990a1d461ca0e7bb46f4d74b70, user_id=4d88bd3cd6ce43e1a458bcfe29e1b59e, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:44.547832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecc1e1-b1da-43e5-b0b6-397f63c72954 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:44.616187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1266/2494] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:04:44 2022] PUT /identity/v3/projects/df0df9990a1d461ca0e7bb46f4d74b70/users/4d88bd3cd6ce43e1a458bcfe29e1b59e/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:44.619951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32194af5-2d74-4f1c-9c62-1838ad4d70d9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:44.648617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32194af5-2d74-4f1c-9c62-1838ad4d70d9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:44.714446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95b272-1dcd-4436-8972-5a3c58dbfb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:44.716082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95b272-1dcd-4436-8972-5a3c58dbfb96 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:44.716371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95b272-1dcd-4436-8972-5a3c58dbfb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:44.716646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95b272-1dcd-4436-8972-5a3c58dbfb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:44.717447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95b272-1dcd-4436-8972-5a3c58dbfb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:44.719959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95b272-1dcd-4436-8972-5a3c58dbfb96 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:44.732291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1229/2495] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:04:44.736137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecc1e1-b1da-43e5-b0b6-397f63c72954 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:44.747119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecc1e1-b1da-43e5-b0b6-397f63c72954 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:44.752432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56831bee-c946-43e3-9c06-26114ae68be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:44.753179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56831bee-c946-43e3-9c06-26114ae68be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:44.753472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56831bee-c946-43e3-9c06-26114ae68be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:44.753750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56831bee-c946-43e3-9c06-26114ae68be3 admin admin] PATH_INFO: `/v3/projects/df0df9990a1d461ca0e7bb46f4d74b70/users/4d88bd3cd6ce43e1a458bcfe29e1b59e/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:44.755847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56831bee-c946-43e3-9c06-26114ae68be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0df9990a1d461ca0e7bb46f4d74b70, user_id=4d88bd3cd6ce43e1a458bcfe29e1b59e, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:44.758559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56831bee-c946-43e3-9c06-26114ae68be3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:44.774121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1267/2496] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:04:44 2022] PUT /identity/v3/projects/df0df9990a1d461ca0e7bb46f4d74b70/users/4d88bd3cd6ce43e1a458bcfe29e1b59e/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:48.550336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b188ee5-5b2e-4037-a0b4-4f6da2c947ea None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:48.550882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b188ee5-5b2e-4037-a0b4-4f6da2c947ea None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:48.562334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b188ee5-5b2e-4037-a0b4-4f6da2c947ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:48.582003 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3b188ee5-5b2e-4037-a0b4-4f6da2c947ea None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:48.583400 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3b188ee5-5b2e-4037-a0b4-4f6da2c947ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:48.670472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:48.689762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1230/2497] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:48.712327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56831bee-c946-43e3-9c06-26114ae68be3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:48.718343 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-56831bee-c946-43e3-9c06-26114ae68be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:48.856421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56831bee-c946-43e3-9c06-26114ae68be3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:48.865111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663544bd-3c7e-4984-91ce-0247c1a125fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:48.866113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663544bd-3c7e-4984-91ce-0247c1a125fa service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:48.866491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663544bd-3c7e-4984-91ce-0247c1a125fa service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:48.866896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663544bd-3c7e-4984-91ce-0247c1a125fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:48.878873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663544bd-3c7e-4984-91ce-0247c1a125fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:48.880527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663544bd-3c7e-4984-91ce-0247c1a125fa service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:48.911122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1268/2498] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:51.701949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8dd9-7f48-4833-95a4-9289ed9b6b80 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:51.702441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8dd9-7f48-4833-95a4-9289ed9b6b80 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:51.702917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8dd9-7f48-4833-95a4-9289ed9b6b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:51.735808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c01c8dd9-7f48-4833-95a4-9289ed9b6b80 None None] MFA Rules not processed for user `4d88bd3cd6ce43e1a458bcfe29e1b59e`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:51.737056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c01c8dd9-7f48-4833-95a4-9289ed9b6b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:51.838652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1231/2499] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:51.855977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663544bd-3c7e-4984-91ce-0247c1a125fa service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:51.873350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663544bd-3c7e-4984-91ce-0247c1a125fa service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:51.888749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726d13-5f45-4f67-ace0-cc60274a443c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:51.889470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726d13-5f45-4f67-ace0-cc60274a443c service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:51.889759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726d13-5f45-4f67-ace0-cc60274a443c service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:51.891533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726d13-5f45-4f67-ace0-cc60274a443c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:51.910409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:52.008561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726d13-5f45-4f67-ace0-cc60274a443c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:52.010265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726d13-5f45-4f67-ace0-cc60274a443c service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:52.021129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1269/2500] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:04:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:04:52.060905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48636714-0653-4deb-a8de-6522800ed201 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:52.061392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48636714-0653-4deb-a8de-6522800ed201 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:52.061770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48636714-0653-4deb-a8de-6522800ed201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:52.084319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-48636714-0653-4deb-a8de-6522800ed201 None None] MFA Rules not processed for user `25274e19c10c4e8fb35b37f06e6bfdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:52.085844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-48636714-0653-4deb-a8de-6522800ed201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:52.153713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1232/2501] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:52.247798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405c348-8b7a-4a7f-b666-319719772d97 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:52.248100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405c348-8b7a-4a7f-b666-319719772d97 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:52.249926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405c348-8b7a-4a7f-b666-319719772d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:52.269538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e405c348-8b7a-4a7f-b666-319719772d97 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:52.270999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e405c348-8b7a-4a7f-b666-319719772d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:52.332250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1270/2502] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 09:04:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:04:52.345052 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48636714-0653-4deb-a8de-6522800ed201 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:04:52.346607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-48636714-0653-4deb-a8de-6522800ed201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:52.418677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48636714-0653-4deb-a8de-6522800ed201 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:04:52.423882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258f5bc-ecb8-4ab7-be31-2c8e1755ef2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:04:52.424757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f5bc-ecb8-4ab7-be31-2c8e1755ef2a service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:52.425042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f5bc-ecb8-4ab7-be31-2c8e1755ef2a service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:52.425399 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258f5bc-ecb8-4ab7-be31-2c8e1755ef2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:52.434036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258f5bc-ecb8-4ab7-be31-2c8e1755ef2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:04:52.435665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258f5bc-ecb8-4ab7-be31-2c8e1755ef2a service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:04:52.443819 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1233/2503] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:04:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 09:04:55.050777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893b7e4-5fc0-4169-8ada-125cfc052034 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:04:55.051293 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893b7e4-5fc0-4169-8ada-125cfc052034 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:04:55.051390 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893b7e4-5fc0-4169-8ada-125cfc052034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:04:55.070585 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8893b7e4-5fc0-4169-8ada-125cfc052034 None None] MFA Rules not processed for user `f4add54c17a64e27a2e2a385f867fc1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:04:55.072065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8893b7e4-5fc0-4169-8ada-125cfc052034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:04:55.079069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1271/2504] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:04:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:05:02.440550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:05.065404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=52 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:06.258861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cd8a-4bca-4ea6-a288-374dac6d94f5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:06.259392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cd8a-4bca-4ea6-a288-374dac6d94f5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:06.259392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cd8a-4bca-4ea6-a288-374dac6d94f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:06.279195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f6f8cd8a-4bca-4ea6-a288-374dac6d94f5 None None] MFA Rules not processed for user `7d1240c674d74311b58fcafe2886ef2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:05:06.281469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6f8cd8a-4bca-4ea6-a288-374dac6d94f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:06.334876 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1234/2505] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:05:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:05:07.271324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb850e-25b1-44b1-ba39-48ab711781fb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:07.271902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb850e-25b1-44b1-ba39-48ab711781fb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:07.272149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb850e-25b1-44b1-ba39-48ab711781fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:07.294239 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b1cb850e-25b1-44b1-ba39-48ab711781fb None None] MFA Rules not processed for user `576fc05d04df45a1a13005361bef8d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:05:07.295631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b1cb850e-25b1-44b1-ba39-48ab711781fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:07.358035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1272/2506] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:05:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:05:16.328275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=25 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:17.349665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=25 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:26.630141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f682b-e0a5-42e6-a539-f4633c1615e5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:26.630683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f682b-e0a5-42e6-a539-f4633c1615e5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:26.630683 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f682b-e0a5-42e6-a539-f4633c1615e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:26.652007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fb5f682b-e0a5-42e6-a539-f4633c1615e5 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:05:26.653220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fb5f682b-e0a5-42e6-a539-f4633c1615e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:26.661957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1235/2507] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:05:26.676785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb850e-25b1-44b1-ba39-48ab711781fb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:05:26.690154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb850e-25b1-44b1-ba39-48ab711781fb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:05:26.695595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74cc8e-8d33-48c6-87e2-1e5b364b5f69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:05:26.701212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74cc8e-8d33-48c6-87e2-1e5b364b5f69 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:26.701212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74cc8e-8d33-48c6-87e2-1e5b364b5f69 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:26.701212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74cc8e-8d33-48c6-87e2-1e5b364b5f69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:26.705475 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74cc8e-8d33-48c6-87e2-1e5b364b5f69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:05:26.707087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74cc8e-8d33-48c6-87e2-1e5b364b5f69 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:05:26.716484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1273/2508] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:05:30.106947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b6e71-9f4f-4c44-990d-5fde9463c859 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:30.107508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b6e71-9f4f-4c44-990d-5fde9463c859 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:30.107508 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b6e71-9f4f-4c44-990d-5fde9463c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:30.128450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d46b6e71-9f4f-4c44-990d-5fde9463c859 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:05:30.130359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d46b6e71-9f4f-4c44-990d-5fde9463c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:30.137505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1236/2509] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:05:30.152640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74cc8e-8d33-48c6-87e2-1e5b364b5f69 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:05:30.164253 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74cc8e-8d33-48c6-87e2-1e5b364b5f69 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:05:30.169775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d31bd4-423e-476e-8353-0be16150e1c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:05:30.170399 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d31bd4-423e-476e-8353-0be16150e1c6 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:30.170681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d31bd4-423e-476e-8353-0be16150e1c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:30.170957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d31bd4-423e-476e-8353-0be16150e1c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:30.180188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d31bd4-423e-476e-8353-0be16150e1c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:05:30.181487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d31bd4-423e-476e-8353-0be16150e1c6 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:05:30.191051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1274/2510] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:05:33.010662 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec129ed8-c76a-4016-96c1-6a0a4b7215b7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:33.011124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec129ed8-c76a-4016-96c1-6a0a4b7215b7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:33.011220 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec129ed8-c76a-4016-96c1-6a0a4b7215b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:33.030686 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ec129ed8-c76a-4016-96c1-6a0a4b7215b7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:05:33.035837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ec129ed8-c76a-4016-96c1-6a0a4b7215b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:33.040384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1237/2511] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:05:33.055353 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d31bd4-423e-476e-8353-0be16150e1c6 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:05:33.067679 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d31bd4-423e-476e-8353-0be16150e1c6 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:05:33.073099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd726de6-13a6-42f3-9b2e-e6395a3fa961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:05:33.073693 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd726de6-13a6-42f3-9b2e-e6395a3fa961 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:33.073975 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd726de6-13a6-42f3-9b2e-e6395a3fa961 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:33.074282 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd726de6-13a6-42f3-9b2e-e6395a3fa961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:33.082420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd726de6-13a6-42f3-9b2e-e6395a3fa961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:05:33.083999 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd726de6-13a6-42f3-9b2e-e6395a3fa961 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:05:33.093791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1275/2512] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:05:37.248991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa34183-ad64-4aa2-a48f-15bb3353cc11 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:37.250038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa34183-ad64-4aa2-a48f-15bb3353cc11 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:37.250240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa34183-ad64-4aa2-a48f-15bb3353cc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:37.269462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1fa34183-ad64-4aa2-a48f-15bb3353cc11 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:05:37.270713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1fa34183-ad64-4aa2-a48f-15bb3353cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:37.278464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1238/2513] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:05:37.297603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd726de6-13a6-42f3-9b2e-e6395a3fa961 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:05:37.308949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd726de6-13a6-42f3-9b2e-e6395a3fa961 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:05:37.315029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f712c-c4d4-4046-8d43-65c882c96a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:05:37.315622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f712c-c4d4-4046-8d43-65c882c96a85 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:37.315904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f712c-c4d4-4046-8d43-65c882c96a85 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:37.316180 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f712c-c4d4-4046-8d43-65c882c96a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:37.324179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f712c-c4d4-4046-8d43-65c882c96a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:05:37.325752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f712c-c4d4-4046-8d43-65c882c96a85 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:05:37.335049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1276/2514] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:05:42.576546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf97859-176a-43fe-a279-fce9eef54726 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:42.577067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf97859-176a-43fe-a279-fce9eef54726 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:42.577067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf97859-176a-43fe-a279-fce9eef54726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:42.597295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1bf97859-176a-43fe-a279-fce9eef54726 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:05:42.598558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1bf97859-176a-43fe-a279-fce9eef54726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:42.606930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1239/2515] 10.222.0.48 () {58 vars in 1016 bytes} [Tue Oct 4 09:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:05:42.621995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f712c-c4d4-4046-8d43-65c882c96a85 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:05:42.633476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f712c-c4d4-4046-8d43-65c882c96a85 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:05:42.638962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563c00e-c49f-46be-ac7f-40e918d8d62e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:05:42.639556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c00e-c49f-46be-ac7f-40e918d8d62e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:42.640012 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c00e-c49f-46be-ac7f-40e918d8d62e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:42.640289 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c00e-c49f-46be-ac7f-40e918d8d62e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:42.649137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563c00e-c49f-46be-ac7f-40e918d8d62e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:05:42.650835 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563c00e-c49f-46be-ac7f-40e918d8d62e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:05:42.660971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1277/2516] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:05:44.863318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2efc-5002-4ca8-b268-7401c5ed41d9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:44.863793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2efc-5002-4ca8-b268-7401c5ed41d9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:44.863904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b2efc-5002-4ca8-b268-7401c5ed41d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:44.882717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-112b2efc-5002-4ca8-b268-7401c5ed41d9 None None] MFA Rules not processed for user `a7120d37c24a48518e9b04c1c119eba5`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:05:44.883913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-112b2efc-5002-4ca8-b268-7401c5ed41d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:44.938125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1240/2517] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:05:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:05:52.655938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=30 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:54.931283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=40 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:11.594454 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faa9e9-fe5c-40dd-b5ce-6d549b6e2ee6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:11.594968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faa9e9-fe5c-40dd-b5ce-6d549b6e2ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:11.594968 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4faa9e9-fe5c-40dd-b5ce-6d549b6e2ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:11.616331 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f4faa9e9-fe5c-40dd-b5ce-6d549b6e2ee6 None None] MFA Rules not processed for user `25274e19c10c4e8fb35b37f06e6bfdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:11.617579 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f4faa9e9-fe5c-40dd-b5ce-6d549b6e2ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:11.625127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1278/2518] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:15.232089 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b2efc-5002-4ca8-b268-7401c5ed41d9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:15.233638 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-112b2efc-5002-4ca8-b268-7401c5ed41d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:15.296307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b2efc-5002-4ca8-b268-7401c5ed41d9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:15.300760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e3ad-c0be-4abb-a5ea-dcd4633e512d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:15.301425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e3ad-c0be-4abb-a5ea-dcd4633e512d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:15.301702 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e3ad-c0be-4abb-a5ea-dcd4633e512d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:15.301972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e3ad-c0be-4abb-a5ea-dcd4633e512d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:15.303839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4cc2e3ad-c0be-4abb-a5ea-dcd4633e512d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:15.317564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2e3ad-c0be-4abb-a5ea-dcd4633e512d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:15.319039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2e3ad-c0be-4abb-a5ea-dcd4633e512d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:15.330795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1241/2519] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:16.158593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faa9e9-fe5c-40dd-b5ce-6d549b6e2ee6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:16.158593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f4faa9e9-fe5c-40dd-b5ce-6d549b6e2ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:16.172605 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4faa9e9-fe5c-40dd-b5ce-6d549b6e2ee6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:16.178274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:16.178920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:16.179204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:16.179480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] PATH_INFO: `/v3/users/576fc05d04df45a1a13005361bef8d3c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:16.181303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=576fc05d04df45a1a13005361bef8d3c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:16.182797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:16.465243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576fc05d04df45a1a13005361bef8d3c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:16.465936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576fc05d04df45a1a13005361bef8d3c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:16.473708 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576fc05d04df45a1a13005361bef8d3c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:16.546778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576fc05d04df45a1a13005361bef8d3c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:16.547388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576fc05d04df45a1a13005361bef8d3c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:16.573973 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1279/2520] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:16 2022] DELETE /identity/v3/users/576fc05d04df45a1a13005361bef8d3c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:16.811446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e3ad-c0be-4abb-a5ea-dcd4633e512d service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:16.827245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e3ad-c0be-4abb-a5ea-dcd4633e512d service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:16.902062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:16.902764 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:16.903322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:16.903629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] PATH_INFO: `/v3/projects/12c59461d66b4df1815882e635d74ad8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:16.905372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c59461d66b4df1815882e635d74ad8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:16.907396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:17.014377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c59461d66b4df1815882e635d74ad8', 'request_id': 'req-8b634f62-f21f-4dc1-bc42-d448e35045fa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:17.021301 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c59461d66b4df1815882e635d74ad8', 'request_id': 'req-8b634f62-f21f-4dc1-bc42-d448e35045fa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:17.026945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c59461d66b4df1815882e635d74ad8', 'request_id': 'req-8b634f62-f21f-4dc1-bc42-d448e35045fa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:17.108954 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] The token cache is being invalidate because project 12c59461d66b4df1815882e635d74ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:17.110400 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:17.111187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:17.113713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1242/2521] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:16 2022] DELETE /identity/v3/projects/12c59461d66b4df1815882e635d74ad8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:19.423037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:19.423037 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:19.437799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc705686-12a1-4003-9bde-d44b76a8c0a2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:19.510588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:19.511808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:19.512327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:19.512848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] PATH_INFO: `/v3/users/f4add54c17a64e27a2e2a385f867fc1d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:19.514302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4add54c17a64e27a2e2a385f867fc1d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:19.516424 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:19.598060 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:19.599766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:19.641470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:19.666354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b634f62-f21f-4dc1-bc42-d448e35045fa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:19.671065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:19.671823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:19.672254 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:19.672630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:19.675614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:19.689690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:19.692250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:19.707121 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1243/2522] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:06:19.744407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4add54c17a64e27a2e2a385f867fc1d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:19.745149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4add54c17a64e27a2e2a385f867fc1d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:19.752558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4add54c17a64e27a2e2a385f867fc1d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:19.843172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4add54c17a64e27a2e2a385f867fc1d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:19.843781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4add54c17a64e27a2e2a385f867fc1d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:19.849765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:19.864596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1280/2523] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:19 2022] DELETE /identity/v3/users/f4add54c17a64e27a2e2a385f867fc1d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:20.141706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:20.143845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:20.157076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ace06-eb14-4ec0-982c-dac4db96558e service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:20.220070 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:20.220730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:20.221014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:20.221292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] PATH_INFO: `/v3/projects/bb911e65e7d94f318dac927aaceae043` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:20.222455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb911e65e7d94f318dac927aaceae043)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:20.224413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:20.352439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb911e65e7d94f318dac927aaceae043', 'request_id': 'req-36d0ec43-cfa0-415c-a576-a79b7eba62e8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.359207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb911e65e7d94f318dac927aaceae043', 'request_id': 'req-36d0ec43-cfa0-415c-a576-a79b7eba62e8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.364895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb911e65e7d94f318dac927aaceae043', 'request_id': 'req-36d0ec43-cfa0-415c-a576-a79b7eba62e8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.455318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] The token cache is being invalidate because project bb911e65e7d94f318dac927aaceae043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:20.455696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.456416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.458066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1244/2524] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:20 2022] DELETE /identity/v3/projects/bb911e65e7d94f318dac927aaceae043 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:20.462120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:20.464686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:20.477671 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9aa48-10b7-4b12-87ee-2673ddce39f7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:20.539034 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:20.539670 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:20.539974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:20.540249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] PATH_INFO: `/v3/users/4d88bd3cd6ce43e1a458bcfe29e1b59e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:20.541419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d88bd3cd6ce43e1a458bcfe29e1b59e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:20.543379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:20.724667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d88bd3cd6ce43e1a458bcfe29e1b59e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.725728 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d88bd3cd6ce43e1a458bcfe29e1b59e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.734611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d88bd3cd6ce43e1a458bcfe29e1b59e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.815614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d88bd3cd6ce43e1a458bcfe29e1b59e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.816345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d88bd3cd6ce43e1a458bcfe29e1b59e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:20.835619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1281/2525] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:20 2022] DELETE /identity/v3/users/4d88bd3cd6ce43e1a458bcfe29e1b59e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:06:21.098242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:21.106324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:21.113185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0ec43-cfa0-415c-a576-a79b7eba62e8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:21.175948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:21.176606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:21.176865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:21.177138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] PATH_INFO: `/v3/projects/df0df9990a1d461ca0e7bb46f4d74b70` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:21.178299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0df9990a1d461ca0e7bb46f4d74b70)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:21.180231 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:21.188687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:21.286360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0df9990a1d461ca0e7bb46f4d74b70', 'request_id': 'req-d1901639-9576-4431-b17f-23cddfe89144'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:21.294573 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0df9990a1d461ca0e7bb46f4d74b70', 'request_id': 'req-d1901639-9576-4431-b17f-23cddfe89144'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:21.300818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0df9990a1d461ca0e7bb46f4d74b70', 'request_id': 'req-d1901639-9576-4431-b17f-23cddfe89144'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:21.432248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] The token cache is being invalidate because project df0df9990a1d461ca0e7bb46f4d74b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:21.432858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:21.433677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:21.435523 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1245/2526] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:21 2022] DELETE /identity/v3/projects/df0df9990a1d461ca0e7bb46f4d74b70 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:23.948683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:23.950739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:23.964655 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe081-553c-4f3f-b637-6a92032a0060 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:24.037705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:24.038412 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:24.038702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:24.038983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] PATH_INFO: `/v3/users/7d1240c674d74311b58fcafe2886ef2c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:24.040159 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1240c674d74311b58fcafe2886ef2c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:24.045265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:24.047692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:24.291471 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1240c674d74311b58fcafe2886ef2c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.292044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1240c674d74311b58fcafe2886ef2c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.299895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1240c674d74311b58fcafe2886ef2c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.392306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1240c674d74311b58fcafe2886ef2c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.393045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e8afa5e-b6ed-4045-820c-c377f24a387c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1240c674d74311b58fcafe2886ef2c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.411495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1282/2527] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:23 2022] DELETE /identity/v3/users/7d1240c674d74311b58fcafe2886ef2c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:24.637937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:24.640994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:24.653331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1901639-9576-4431-b17f-23cddfe89144 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:24.711717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:24.712368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:24.712651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:24.712926 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] PATH_INFO: `/v3/projects/2b93ea96d97c442db8a0559547db82aa` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:24.714063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b93ea96d97c442db8a0559547db82aa)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:24.716043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:24.833548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b93ea96d97c442db8a0559547db82aa', 'request_id': 'req-f5502e21-ee72-4dd5-a690-71640a986e01'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.839840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b93ea96d97c442db8a0559547db82aa', 'request_id': 'req-f5502e21-ee72-4dd5-a690-71640a986e01'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.845271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b93ea96d97c442db8a0559547db82aa', 'request_id': 'req-f5502e21-ee72-4dd5-a690-71640a986e01'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.934160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] The token cache is being invalidate because project 2b93ea96d97c442db8a0559547db82aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:24.934387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.935023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f5502e21-ee72-4dd5-a690-71640a986e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:24.936514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1246/2528] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:24 2022] DELETE /identity/v3/projects/2b93ea96d97c442db8a0559547db82aa => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:24.942350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cdc96-e3a1-43e1-9e3e-62b0f2bee5f8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:24.942645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cdc96-e3a1-43e1-9e3e-62b0f2bee5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:24.943351 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cdc96-e3a1-43e1-9e3e-62b0f2bee5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:24.964508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-be8cdc96-e3a1-43e1-9e3e-62b0f2bee5f8 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:24.966069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be8cdc96-e3a1-43e1-9e3e-62b0f2bee5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:25.023934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1283/2529] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:25.031848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e216bd3-10af-4c7e-9375-2aeee0507802 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:25.032154 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e216bd3-10af-4c7e-9375-2aeee0507802 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:25.032407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e216bd3-10af-4c7e-9375-2aeee0507802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:25.052712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8e216bd3-10af-4c7e-9375-2aeee0507802 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:25.053978 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8e216bd3-10af-4c7e-9375-2aeee0507802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:25.061964 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1247/2530] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:25.066775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cdc96-e3a1-43e1-9e3e-62b0f2bee5f8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:25.077611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cdc96-e3a1-43e1-9e3e-62b0f2bee5f8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:25.082405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13fd22-6c56-4357-b4e3-f09ab28e93dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:25.083003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13fd22-6c56-4357-b4e3-f09ab28e93dd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:25.083281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13fd22-6c56-4357-b4e3-f09ab28e93dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:25.083572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13fd22-6c56-4357-b4e3-f09ab28e93dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:25.084221 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13fd22-6c56-4357-b4e3-f09ab28e93dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:06:25.084527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13fd22-6c56-4357-b4e3-f09ab28e93dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:25.086150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13fd22-6c56-4357-b4e3-f09ab28e93dd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:25.097544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1284/2531] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:06:25.101820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e216bd3-10af-4c7e-9375-2aeee0507802 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:25.111525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e216bd3-10af-4c7e-9375-2aeee0507802 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:25.116143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cf998-0c66-40f7-97fc-776fbec922ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:25.116737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cf998-0c66-40f7-97fc-776fbec922ef admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:25.117014 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cf998-0c66-40f7-97fc-776fbec922ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:25.117281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cf998-0c66-40f7-97fc-776fbec922ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:25.117914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cf998-0c66-40f7-97fc-776fbec922ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:25.119835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cf998-0c66-40f7-97fc-776fbec922ef admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:25.204057 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:25.211389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1248/2532] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:25 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:06:25.215625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13fd22-6c56-4357-b4e3-f09ab28e93dd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:25.225950 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13fd22-6c56-4357-b4e3-f09ab28e93dd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:25.285535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6e825-7055-4690-83b1-bfd78b8fe661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:25.286192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6e825-7055-4690-83b1-bfd78b8fe661 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:25.286474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6e825-7055-4690-83b1-bfd78b8fe661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:25.286750 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6e825-7055-4690-83b1-bfd78b8fe661 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:25.287385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6e825-7055-4690-83b1-bfd78b8fe661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:25.289345 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6e825-7055-4690-83b1-bfd78b8fe661 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:25.342325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:25.347527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1285/2533] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:25 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:25.351850 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cf998-0c66-40f7-97fc-776fbec922ef admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:25.363074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cf998-0c66-40f7-97fc-776fbec922ef admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:25.367918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71312aec-b0ab-455f-86e0-56b8233b096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:25.368526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71312aec-b0ab-455f-86e0-56b8233b096f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:25.368811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71312aec-b0ab-455f-86e0-56b8233b096f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:25.369116 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71312aec-b0ab-455f-86e0-56b8233b096f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:25.369771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71312aec-b0ab-455f-86e0-56b8233b096f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:25.371510 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71312aec-b0ab-455f-86e0-56b8233b096f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:25.383017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1249/2534] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:25.387025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6e825-7055-4690-83b1-bfd78b8fe661 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:25.397213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6e825-7055-4690-83b1-bfd78b8fe661 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:25.402123 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f1d18-fa3f-45a7-a16d-12cfe6bea4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:25.402739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1d18-fa3f-45a7-a16d-12cfe6bea4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:25.403217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1d18-fa3f-45a7-a16d-12cfe6bea4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:25.403688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f1d18-fa3f-45a7-a16d-12cfe6bea4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:25.404712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f1d18-fa3f-45a7-a16d-12cfe6bea4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:25.406435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f1d18-fa3f-45a7-a16d-12cfe6bea4d2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:25.417120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1286/2535] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:25.421876 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71312aec-b0ab-455f-86e0-56b8233b096f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:25.432332 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71312aec-b0ab-455f-86e0-56b8233b096f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:25.437022 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6b494-13c1-4f96-a1af-1a5655cf6e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:25.437667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6b494-13c1-4f96-a1af-1a5655cf6e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:25.437953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6b494-13c1-4f96-a1af-1a5655cf6e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:25.438271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6b494-13c1-4f96-a1af-1a5655cf6e3f admin admin] PATH_INFO: `/v3/projects/5d14e5476b024ac0b8817eb9b55044cf/users/d8c446a8feab4ef2a88a32520979a45c/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:25.452909 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6b494-13c1-4f96-a1af-1a5655cf6e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d14e5476b024ac0b8817eb9b55044cf, user_id=d8c446a8feab4ef2a88a32520979a45c, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:25.455692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6b494-13c1-4f96-a1af-1a5655cf6e3f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:25.523743 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1250/2536] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:25 2022] PUT /identity/v3/projects/5d14e5476b024ac0b8817eb9b55044cf/users/d8c446a8feab4ef2a88a32520979a45c/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:25.535558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc69db-74c9-4c61-85ee-4ef49f667cd2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:25.535878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc69db-74c9-4c61-85ee-4ef49f667cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:25.536158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc69db-74c9-4c61-85ee-4ef49f667cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:25.565518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-32dc69db-74c9-4c61-85ee-4ef49f667cd2 None None] MFA Rules not processed for user `d8c446a8feab4ef2a88a32520979a45c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:25.566759 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32dc69db-74c9-4c61-85ee-4ef49f667cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:25.628879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1287/2537] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:25.639846 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6b494-13c1-4f96-a1af-1a5655cf6e3f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:25.641596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1ca6b494-13c1-4f96-a1af-1a5655cf6e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:25.716920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6b494-13c1-4f96-a1af-1a5655cf6e3f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:25.724845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa22d0-761c-4734-a4f5-51571722a58c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:25.725425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa22d0-761c-4734-a4f5-51571722a58c service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:25.725713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa22d0-761c-4734-a4f5-51571722a58c service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:25.725994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa22d0-761c-4734-a4f5-51571722a58c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:25.735126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa22d0-761c-4734-a4f5-51571722a58c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:25.737304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa22d0-761c-4734-a4f5-51571722a58c service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:25.746597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1251/2538] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:26.001837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc69db-74c9-4c61-85ee-4ef49f667cd2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:26.064435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc69db-74c9-4c61-85ee-4ef49f667cd2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:26.069099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:26.069802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:26.070113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:26.070402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] PATH_INFO: `/v3/users/d8c446a8feab4ef2a88a32520979a45c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:26.071548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c446a8feab4ef2a88a32520979a45c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:26.073481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:26.274275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c446a8feab4ef2a88a32520979a45c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:26.274953 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c446a8feab4ef2a88a32520979a45c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:26.282004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c446a8feab4ef2a88a32520979a45c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:26.384947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c446a8feab4ef2a88a32520979a45c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:26.385587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c446a8feab4ef2a88a32520979a45c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:26.400480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:26.404847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1288/2539] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:26 2022] DELETE /identity/v3/users/d8c446a8feab4ef2a88a32520979a45c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:06:26.409264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4a81c-f0ef-4521-842d-1a82583fb800 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:26.409556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4a81c-f0ef-4521-842d-1a82583fb800 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:26.409855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4a81c-f0ef-4521-842d-1a82583fb800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:26.429127 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-72c4a81c-f0ef-4521-842d-1a82583fb800 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:26.430383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-72c4a81c-f0ef-4521-842d-1a82583fb800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:26.494783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1252/2540] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:26.505220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:26.506662 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:26.565555 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d632b3-5730-43c9-80c9-4dd19babcfd3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:26.569204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c83d2-7c1d-43fe-a10a-15c8a81ed44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:26.569805 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c83d2-7c1d-43fe-a10a-15c8a81ed44f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:26.570097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c83d2-7c1d-43fe-a10a-15c8a81ed44f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:26.570381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c83d2-7c1d-43fe-a10a-15c8a81ed44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:26.579229 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c83d2-7c1d-43fe-a10a-15c8a81ed44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:26.580660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c83d2-7c1d-43fe-a10a-15c8a81ed44f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:26.589842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1289/2541] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:26.993747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4a81c-f0ef-4521-842d-1a82583fb800 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:26.996971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-72c4a81c-f0ef-4521-842d-1a82583fb800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:27.007597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4a81c-f0ef-4521-842d-1a82583fb800 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:27.012223 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:27.012856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.013136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.013413 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] PATH_INFO: `/v3/projects/5d14e5476b024ac0b8817eb9b55044cf` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.014566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d14e5476b024ac0b8817eb9b55044cf)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:27.016584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:27.115048 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:27.118677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d14e5476b024ac0b8817eb9b55044cf', 'request_id': 'req-fc5baf06-8e2b-443f-867f-c77579b8b4b7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:27.124886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d14e5476b024ac0b8817eb9b55044cf', 'request_id': 'req-fc5baf06-8e2b-443f-867f-c77579b8b4b7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:27.130265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d14e5476b024ac0b8817eb9b55044cf', 'request_id': 'req-fc5baf06-8e2b-443f-867f-c77579b8b4b7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:27.219351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] The token cache is being invalidate because project 5d14e5476b024ac0b8817eb9b55044cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:27.220214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:27.220882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fc5baf06-8e2b-443f-867f-c77579b8b4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:27.222414 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1253/2542] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:26 2022] DELETE /identity/v3/projects/5d14e5476b024ac0b8817eb9b55044cf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:27.227306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcce9c-175f-4e60-bd61-67d3c7a19b3a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.227768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcce9c-175f-4e60-bd61-67d3c7a19b3a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.227863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcce9c-175f-4e60-bd61-67d3c7a19b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.248046 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-35bcce9c-175f-4e60-bd61-67d3c7a19b3a None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:27.249267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-35bcce9c-175f-4e60-bd61-67d3c7a19b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:27.306919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1290/2543] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:27.314461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54535131-72a6-4dfc-a74f-e26cf91ac89d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.314748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54535131-72a6-4dfc-a74f-e26cf91ac89d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.315021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54535131-72a6-4dfc-a74f-e26cf91ac89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.335829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-54535131-72a6-4dfc-a74f-e26cf91ac89d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:27.337023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-54535131-72a6-4dfc-a74f-e26cf91ac89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:27.344988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1254/2544] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:27.349528 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcce9c-175f-4e60-bd61-67d3c7a19b3a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:27.359137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcce9c-175f-4e60-bd61-67d3c7a19b3a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:27.363919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abedaf3-5c69-47e9-9adc-8a18cc1f5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:27.364516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abedaf3-5c69-47e9-9adc-8a18cc1f5e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.364797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abedaf3-5c69-47e9-9adc-8a18cc1f5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.365072 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abedaf3-5c69-47e9-9adc-8a18cc1f5e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.365719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abedaf3-5c69-47e9-9adc-8a18cc1f5e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:06:27.366024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abedaf3-5c69-47e9-9adc-8a18cc1f5e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:27.367695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abedaf3-5c69-47e9-9adc-8a18cc1f5e19 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:27.379196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1291/2545] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:06:27.383387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54535131-72a6-4dfc-a74f-e26cf91ac89d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:27.393041 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54535131-72a6-4dfc-a74f-e26cf91ac89d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:27.397582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774e0d2-e433-40b9-a7be-c403cd26d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:27.398205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774e0d2-e433-40b9-a7be-c403cd26d424 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.398545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774e0d2-e433-40b9-a7be-c403cd26d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.398755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774e0d2-e433-40b9-a7be-c403cd26d424 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.399389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774e0d2-e433-40b9-a7be-c403cd26d424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:27.401282 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774e0d2-e433-40b9-a7be-c403cd26d424 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:27.515731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1255/2546] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:27 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:27.517923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abedaf3-5c69-47e9-9adc-8a18cc1f5e19 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:27.527868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abedaf3-5c69-47e9-9adc-8a18cc1f5e19 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:27.586342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc076ee-19c7-401c-ab47-65b092cfd75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:27.586877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc076ee-19c7-401c-ab47-65b092cfd75e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.587227 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc076ee-19c7-401c-ab47-65b092cfd75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.587567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc076ee-19c7-401c-ab47-65b092cfd75e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.588286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc076ee-19c7-401c-ab47-65b092cfd75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:27.590298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc076ee-19c7-401c-ab47-65b092cfd75e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:27.690198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1292/2547] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:27 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:27.694489 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774e0d2-e433-40b9-a7be-c403cd26d424 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:27.705369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774e0d2-e433-40b9-a7be-c403cd26d424 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:27.710667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c496810-5181-4e4c-8ebd-9d8718f2774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:27.711394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c496810-5181-4e4c-8ebd-9d8718f2774e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.711777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c496810-5181-4e4c-8ebd-9d8718f2774e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.712153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c496810-5181-4e4c-8ebd-9d8718f2774e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.712905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c496810-5181-4e4c-8ebd-9d8718f2774e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:27.714930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c496810-5181-4e4c-8ebd-9d8718f2774e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:27.727599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1256/2548] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:27.731909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc076ee-19c7-401c-ab47-65b092cfd75e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:27.743533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc076ee-19c7-401c-ab47-65b092cfd75e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:27.750398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe556d9-6035-44f4-bab0-04b673f086d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:27.751561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe556d9-6035-44f4-bab0-04b673f086d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.751865 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe556d9-6035-44f4-bab0-04b673f086d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.752136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe556d9-6035-44f4-bab0-04b673f086d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.752780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe556d9-6035-44f4-bab0-04b673f086d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:27.754448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe556d9-6035-44f4-bab0-04b673f086d6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:27.764478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1293/2549] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:06:27.769522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c496810-5181-4e4c-8ebd-9d8718f2774e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:27.779549 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c496810-5181-4e4c-8ebd-9d8718f2774e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:27.784481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5731c-cd0b-48f8-8206-e4f5ba53b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:27.785162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5731c-cd0b-48f8-8206-e4f5ba53b947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.785444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5731c-cd0b-48f8-8206-e4f5ba53b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.785720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5731c-cd0b-48f8-8206-e4f5ba53b947 admin admin] PATH_INFO: `/v3/projects/aede10a6103e4de0844372247758d5ea/users/aa82efd4006e4f60887bd1914d413526/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.800370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5731c-cd0b-48f8-8206-e4f5ba53b947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aede10a6103e4de0844372247758d5ea, user_id=aa82efd4006e4f60887bd1914d413526, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:27.803064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5731c-cd0b-48f8-8206-e4f5ba53b947 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:27.895409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1257/2550] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:27 2022] PUT /identity/v3/projects/aede10a6103e4de0844372247758d5ea/users/aa82efd4006e4f60887bd1914d413526/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:27.905784 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9760ca5-d3b4-46e5-ae7d-9e6f946666cb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:27.906074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9760ca5-d3b4-46e5-ae7d-9e6f946666cb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:27.906385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9760ca5-d3b4-46e5-ae7d-9e6f946666cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:27.920626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:27.934892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c9760ca5-d3b4-46e5-ae7d-9e6f946666cb None None] MFA Rules not processed for user `aa82efd4006e4f60887bd1914d413526`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:27.936107 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c9760ca5-d3b4-46e5-ae7d-9e6f946666cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:27.999383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1294/2551] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:28.004454 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5731c-cd0b-48f8-8206-e4f5ba53b947 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:28.065649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5731c-cd0b-48f8-8206-e4f5ba53b947 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:28.070374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dff4b-f478-409d-99a4-260feb782556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:28.070979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dff4b-f478-409d-99a4-260feb782556 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:28.071263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dff4b-f478-409d-99a4-260feb782556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:28.071547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dff4b-f478-409d-99a4-260feb782556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:28.072193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dff4b-f478-409d-99a4-260feb782556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:28.074072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dff4b-f478-409d-99a4-260feb782556 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:28.146908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1258/2552] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:28 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:28.150942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9760ca5-d3b4-46e5-ae7d-9e6f946666cb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:28.161829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9760ca5-d3b4-46e5-ae7d-9e6f946666cb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:28.218111 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563e8de-881b-4abe-9820-dbc7cf7a1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:28.218792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563e8de-881b-4abe-9820-dbc7cf7a1183 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:28.219074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563e8de-881b-4abe-9820-dbc7cf7a1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:28.219347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563e8de-881b-4abe-9820-dbc7cf7a1183 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:28.219977 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563e8de-881b-4abe-9820-dbc7cf7a1183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:28.222099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563e8de-881b-4abe-9820-dbc7cf7a1183 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:28.288699 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1295/2553] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:28 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:28.292766 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dff4b-f478-409d-99a4-260feb782556 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:28.303807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dff4b-f478-409d-99a4-260feb782556 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:28.308488 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e90ea-58bb-4622-9bb4-fb9d6041302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:28.309088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e90ea-58bb-4622-9bb4-fb9d6041302c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:28.309370 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e90ea-58bb-4622-9bb4-fb9d6041302c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:28.309645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e90ea-58bb-4622-9bb4-fb9d6041302c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:28.310327 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e90ea-58bb-4622-9bb4-fb9d6041302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:28.311923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e90ea-58bb-4622-9bb4-fb9d6041302c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:28.322773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1259/2554] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:28.326775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563e8de-881b-4abe-9820-dbc7cf7a1183 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:28.336592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563e8de-881b-4abe-9820-dbc7cf7a1183 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:28.341179 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bd680-1dc8-4060-aa77-e4a60790156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:28.341821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd680-1dc8-4060-aa77-e4a60790156e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:28.342144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd680-1dc8-4060-aa77-e4a60790156e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:28.342405 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd680-1dc8-4060-aa77-e4a60790156e admin admin] PATH_INFO: `/v3/projects/bb20b1eddade49c28eaad4891c850c36/users/682457b8b35e4a5da3f97965164cddf0/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:28.356911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bd680-1dc8-4060-aa77-e4a60790156e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb20b1eddade49c28eaad4891c850c36, user_id=682457b8b35e4a5da3f97965164cddf0, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:28.359587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bd680-1dc8-4060-aa77-e4a60790156e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:28.420228 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1296/2555] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:28 2022] PUT /identity/v3/projects/bb20b1eddade49c28eaad4891c850c36/users/682457b8b35e4a5da3f97965164cddf0/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:28.424651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e90ea-58bb-4622-9bb4-fb9d6041302c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:28.434977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e90ea-58bb-4622-9bb4-fb9d6041302c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:28.474062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:28.490076 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8947-bf7d-4028-9af2-8ef31d9d637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:28.490707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8947-bf7d-4028-9af2-8ef31d9d637c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:28.490989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8947-bf7d-4028-9af2-8ef31d9d637c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:28.491266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8947-bf7d-4028-9af2-8ef31d9d637c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:28.491900 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8947-bf7d-4028-9af2-8ef31d9d637c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:28.493476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8947-bf7d-4028-9af2-8ef31d9d637c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:28.503346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1260/2556] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:28.508735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bd680-1dc8-4060-aa77-e4a60790156e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:28.519069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bd680-1dc8-4060-aa77-e4a60790156e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:28.523765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf70af-7709-47f9-8675-5d46557a5e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:28.524533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf70af-7709-47f9-8675-5d46557a5e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:28.524843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf70af-7709-47f9-8675-5d46557a5e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:28.525121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf70af-7709-47f9-8675-5d46557a5e7f admin admin] PATH_INFO: `/v3/projects/bb20b1eddade49c28eaad4891c850c36/users/682457b8b35e4a5da3f97965164cddf0/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:28.527080 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf70af-7709-47f9-8675-5d46557a5e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb20b1eddade49c28eaad4891c850c36, user_id=682457b8b35e4a5da3f97965164cddf0, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:28.529843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf70af-7709-47f9-8675-5d46557a5e7f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:28.540504 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1297/2557] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:28 2022] PUT /identity/v3/projects/bb20b1eddade49c28eaad4891c850c36/users/682457b8b35e4a5da3f97965164cddf0/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:28.552663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06182508-aae2-4a4c-a13a-bcaa8c2010d2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:28.552955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06182508-aae2-4a4c-a13a-bcaa8c2010d2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:28.553234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06182508-aae2-4a4c-a13a-bcaa8c2010d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:28.579935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-06182508-aae2-4a4c-a13a-bcaa8c2010d2 None None] MFA Rules not processed for user `682457b8b35e4a5da3f97965164cddf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:28.581147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-06182508-aae2-4a4c-a13a-bcaa8c2010d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:28.646506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1261/2558] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:28.658393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf70af-7709-47f9-8675-5d46557a5e7f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:28.660099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-19bf70af-7709-47f9-8675-5d46557a5e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:28.713335 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:28.716921 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf70af-7709-47f9-8675-5d46557a5e7f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:28.721044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bd2f4-6543-4126-b9ca-fa6deb163d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:28.721634 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bd2f4-6543-4126-b9ca-fa6deb163d6b service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:28.721911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bd2f4-6543-4126-b9ca-fa6deb163d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:28.722246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bd2f4-6543-4126-b9ca-fa6deb163d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:28.731323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bd2f4-6543-4126-b9ca-fa6deb163d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:28.732775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bd2f4-6543-4126-b9ca-fa6deb163d6b service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:28.742941 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1298/2559] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:28.968316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06182508-aae2-4a4c-a13a-bcaa8c2010d2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:28.970548 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-06182508-aae2-4a4c-a13a-bcaa8c2010d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:29.026612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06182508-aae2-4a4c-a13a-bcaa8c2010d2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:29.030899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfca12-f49a-4602-9ba8-ce45ef0fa192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:29.031314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfca12-f49a-4602-9ba8-ce45ef0fa192 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:29.032755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfca12-f49a-4602-9ba8-ce45ef0fa192 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:29.033480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfca12-f49a-4602-9ba8-ce45ef0fa192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:29.035400 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3bdfca12-f49a-4602-9ba8-ce45ef0fa192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:29.100419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfca12-f49a-4602-9ba8-ce45ef0fa192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:29.101869 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfca12-f49a-4602-9ba8-ce45ef0fa192 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:29.111604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1262/2560] 10.222.0.33 () {60 vars in 1396 bytes} [Tue Oct 4 09:06:28 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:29.641861 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bd2f4-6543-4126-b9ca-fa6deb163d6b service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:29.703170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bd2f4-6543-4126-b9ca-fa6deb163d6b service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:29.707730 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:29.708339 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:29.708621 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:29.708890 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] PATH_INFO: `/v3/users/aa82efd4006e4f60887bd1914d413526` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:29.710013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa82efd4006e4f60887bd1914d413526)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:29.711975 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:29.883615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa82efd4006e4f60887bd1914d413526'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:29.884389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa82efd4006e4f60887bd1914d413526'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:29.891960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa82efd4006e4f60887bd1914d413526'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:29.958032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa82efd4006e4f60887bd1914d413526'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:29.958600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa82efd4006e4f60887bd1914d413526'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:29.980260 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1299/2561] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:29 2022] DELETE /identity/v3/users/aa82efd4006e4f60887bd1914d413526 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:29.985757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c184-fbad-4fae-99a4-5ed2efb87c92 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:29.985906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c184-fbad-4fae-99a4-5ed2efb87c92 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:29.986181 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c184-fbad-4fae-99a4-5ed2efb87c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:30.006727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b062c184-fbad-4fae-99a4-5ed2efb87c92 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:30.007949 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b062c184-fbad-4fae-99a4-5ed2efb87c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:30.020470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:30.068936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1263/2562] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:30.086210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:30.088881 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:30.150675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7b6e4-58f3-452b-a155-d0cca8b07224 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:30.154801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f4511-b0c6-4047-9c68-72d0fae3ce44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:30.155427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f4511-b0c6-4047-9c68-72d0fae3ce44 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:30.155713 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f4511-b0c6-4047-9c68-72d0fae3ce44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:30.155993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f4511-b0c6-4047-9c68-72d0fae3ce44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:30.166065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f4511-b0c6-4047-9c68-72d0fae3ce44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:30.167577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f4511-b0c6-4047-9c68-72d0fae3ce44 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:30.177939 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1300/2563] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:30.752219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062c184-fbad-4fae-99a4-5ed2efb87c92 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:30.753872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b062c184-fbad-4fae-99a4-5ed2efb87c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:30.767537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062c184-fbad-4fae-99a4-5ed2efb87c92 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:30.774307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:30.775072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:30.775442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:30.775820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] PATH_INFO: `/v3/projects/aede10a6103e4de0844372247758d5ea` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:30.777175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aede10a6103e4de0844372247758d5ea)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:30.779635 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:30.903378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aede10a6103e4de0844372247758d5ea', 'request_id': 'req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:30.910493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aede10a6103e4de0844372247758d5ea', 'request_id': 'req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:30.916667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aede10a6103e4de0844372247758d5ea', 'request_id': 'req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.009325 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] The token cache is being invalidate because project aede10a6103e4de0844372247758d5ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:31.009660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.010302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.011836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1264/2564] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:30 2022] DELETE /identity/v3/projects/aede10a6103e4de0844372247758d5ea => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:06:31.015860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f4511-b0c6-4047-9c68-72d0fae3ce44 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:31.028284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f4511-b0c6-4047-9c68-72d0fae3ce44 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:31.038550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:31.086850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:31.087533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:31.087812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:31.088086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] PATH_INFO: `/v3/users/682457b8b35e4a5da3f97965164cddf0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:31.089208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] RBAC: Authorizing `identity:delete_user(user_id=682457b8b35e4a5da3f97965164cddf0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:31.091176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:31.305340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682457b8b35e4a5da3f97965164cddf0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.306041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682457b8b35e4a5da3f97965164cddf0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.313897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682457b8b35e4a5da3f97965164cddf0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.374539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682457b8b35e4a5da3f97965164cddf0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.375204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d76ffde-9244-4706-9559-2ef5e941317d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682457b8b35e4a5da3f97965164cddf0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.394067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1301/2565] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:31 2022] DELETE /identity/v3/users/682457b8b35e4a5da3f97965164cddf0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:31.769918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:31.771420 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:31.784929 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2961ca9-6ff5-46cc-ada3-f0963c270d0b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:31.841126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:31.841685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:31.841965 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:31.842280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] PATH_INFO: `/v3/projects/bb20b1eddade49c28eaad4891c850c36` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:31.843394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb20b1eddade49c28eaad4891c850c36)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:31.845977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:31.920058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:31.923680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb20b1eddade49c28eaad4891c850c36', 'request_id': 'req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.929847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb20b1eddade49c28eaad4891c850c36', 'request_id': 'req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.935765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb20b1eddade49c28eaad4891c850c36', 'request_id': 'req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.979102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] The token cache is being invalidate because project bb20b1eddade49c28eaad4891c850c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:31.979406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.980074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0a99a3b-c589-483a-9db6-ecdbdbf3bc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:31.981555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1265/2566] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:31 2022] DELETE /identity/v3/projects/bb20b1eddade49c28eaad4891c850c36 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:31.986493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baa5cc-e4ee-4229-a413-ff8847f83957 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:31.986869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baa5cc-e4ee-4229-a413-ff8847f83957 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:31.987156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5baa5cc-e4ee-4229-a413-ff8847f83957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.008678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f5baa5cc-e4ee-4229-a413-ff8847f83957 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:32.009965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f5baa5cc-e4ee-4229-a413-ff8847f83957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:32.069658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1302/2567] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:32.077751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd26b0-6297-4076-af4b-ca8ba6b1333e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.078043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd26b0-6297-4076-af4b-ca8ba6b1333e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.078358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd26b0-6297-4076-af4b-ca8ba6b1333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.098856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-08cd26b0-6297-4076-af4b-ca8ba6b1333e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:32.099996 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-08cd26b0-6297-4076-af4b-ca8ba6b1333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:32.107997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1266/2568] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:32.112142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baa5cc-e4ee-4229-a413-ff8847f83957 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:32.121927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5baa5cc-e4ee-4229-a413-ff8847f83957 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:32.126607 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c7cfe-77cf-497b-b1fd-82150828841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:32.127204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c7cfe-77cf-497b-b1fd-82150828841c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.127486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c7cfe-77cf-497b-b1fd-82150828841c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.127760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c7cfe-77cf-497b-b1fd-82150828841c admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.128408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c7cfe-77cf-497b-b1fd-82150828841c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:06:32.128711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c7cfe-77cf-497b-b1fd-82150828841c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:32.130350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c7cfe-77cf-497b-b1fd-82150828841c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:32.142802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1303/2569] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:06:32.147278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd26b0-6297-4076-af4b-ca8ba6b1333e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:32.156517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd26b0-6297-4076-af4b-ca8ba6b1333e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:32.161991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fba9dc-b046-468f-b13b-e23774e258a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:32.162620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba9dc-b046-468f-b13b-e23774e258a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.162899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba9dc-b046-468f-b13b-e23774e258a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.163169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba9dc-b046-468f-b13b-e23774e258a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.163800 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fba9dc-b046-468f-b13b-e23774e258a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:32.165790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fba9dc-b046-468f-b13b-e23774e258a6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:32.277581 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1267/2570] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:32 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:32.282016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c7cfe-77cf-497b-b1fd-82150828841c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:32.291914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c7cfe-77cf-497b-b1fd-82150828841c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:32.308896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:32.350724 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63379d76-60fe-42da-a41b-78aa00f1cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:32.351213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379d76-60fe-42da-a41b-78aa00f1cc77 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.351492 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379d76-60fe-42da-a41b-78aa00f1cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.351765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379d76-60fe-42da-a41b-78aa00f1cc77 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.352393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63379d76-60fe-42da-a41b-78aa00f1cc77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:32.354350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63379d76-60fe-42da-a41b-78aa00f1cc77 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:32.420170 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1304/2571] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:32 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:32.424447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fba9dc-b046-468f-b13b-e23774e258a6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:32.434696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fba9dc-b046-468f-b13b-e23774e258a6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:32.439925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa8fa7-8109-42b7-a3a6-d6cf76d9ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:32.440524 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8fa7-8109-42b7-a3a6-d6cf76d9ad87 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.440810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8fa7-8109-42b7-a3a6-d6cf76d9ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.441085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8fa7-8109-42b7-a3a6-d6cf76d9ad87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.441777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa8fa7-8109-42b7-a3a6-d6cf76d9ad87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:32.443415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa8fa7-8109-42b7-a3a6-d6cf76d9ad87 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:32.453106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1268/2572] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:32.457596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63379d76-60fe-42da-a41b-78aa00f1cc77 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:32.468004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63379d76-60fe-42da-a41b-78aa00f1cc77 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:32.472754 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24ae8b-36b8-4a42-824c-ddd6adabbfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:32.473341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24ae8b-36b8-4a42-824c-ddd6adabbfcf admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.473623 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24ae8b-36b8-4a42-824c-ddd6adabbfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.473898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24ae8b-36b8-4a42-824c-ddd6adabbfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.474584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24ae8b-36b8-4a42-824c-ddd6adabbfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:32.476886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24ae8b-36b8-4a42-824c-ddd6adabbfcf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:32.487362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1305/2573] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:32.491479 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa8fa7-8109-42b7-a3a6-d6cf76d9ad87 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:32.502066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa8fa7-8109-42b7-a3a6-d6cf76d9ad87 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:32.506706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc9b1-2940-41d8-99f5-eadd248d7d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:32.507358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc9b1-2940-41d8-99f5-eadd248d7d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.507643 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc9b1-2940-41d8-99f5-eadd248d7d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.507920 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc9b1-2940-41d8-99f5-eadd248d7d75 admin admin] PATH_INFO: `/v3/projects/7f970e83129543ee8b086e0cbb60d56d/users/3bef1cb31678411dbac0fe3d89f9ec36/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.522816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dc9b1-2940-41d8-99f5-eadd248d7d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f970e83129543ee8b086e0cbb60d56d, user_id=3bef1cb31678411dbac0fe3d89f9ec36, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:32.525459 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dc9b1-2940-41d8-99f5-eadd248d7d75 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:32.591627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1269/2574] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:32 2022] PUT /identity/v3/projects/7f970e83129543ee8b086e0cbb60d56d/users/3bef1cb31678411dbac0fe3d89f9ec36/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:32.602073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2b41a-1034-425e-be1d-8250c70b26ba None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.602334 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2b41a-1034-425e-be1d-8250c70b26ba None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.602609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2b41a-1034-425e-be1d-8250c70b26ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.630434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-abe2b41a-1034-425e-be1d-8250c70b26ba None None] MFA Rules not processed for user `3bef1cb31678411dbac0fe3d89f9ec36`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:32.631645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-abe2b41a-1034-425e-be1d-8250c70b26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:32.693682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1306/2575] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:32.698286 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc9b1-2940-41d8-99f5-eadd248d7d75 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:32.758294 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc9b1-2940-41d8-99f5-eadd248d7d75 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:32.762935 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3f42-3b13-4b32-b640-ada33f63ab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:32.763535 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3f42-3b13-4b32-b640-ada33f63ab02 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.763818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3f42-3b13-4b32-b640-ada33f63ab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.764093 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a3f42-3b13-4b32-b640-ada33f63ab02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.764716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a3f42-3b13-4b32-b640-ada33f63ab02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:32.766647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a3f42-3b13-4b32-b640-ada33f63ab02 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:32.839444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1270/2576] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:32 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:32.843544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2b41a-1034-425e-be1d-8250c70b26ba None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:32.854985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2b41a-1034-425e-be1d-8250c70b26ba None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:32.918252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046c249-b7b4-4c23-93ed-6497f7a04847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:32.919121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046c249-b7b4-4c23-93ed-6497f7a04847 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:32.919403 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046c249-b7b4-4c23-93ed-6497f7a04847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:32.919677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046c249-b7b4-4c23-93ed-6497f7a04847 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:32.920304 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046c249-b7b4-4c23-93ed-6497f7a04847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:32.922771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046c249-b7b4-4c23-93ed-6497f7a04847 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:33.033017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1307/2577] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:32 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:06:33.037196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3f42-3b13-4b32-b640-ada33f63ab02 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:33.048830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a3f42-3b13-4b32-b640-ada33f63ab02 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:33.055029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c589c9b-686c-410d-83be-4095aeda9bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:33.055029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c589c9b-686c-410d-83be-4095aeda9bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:33.055029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c589c9b-686c-410d-83be-4095aeda9bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:33.055360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c589c9b-686c-410d-83be-4095aeda9bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:33.055749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c589c9b-686c-410d-83be-4095aeda9bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:33.057365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c589c9b-686c-410d-83be-4095aeda9bb0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:33.068350 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1271/2578] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:33.072549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046c249-b7b4-4c23-93ed-6497f7a04847 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:33.082893 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046c249-b7b4-4c23-93ed-6497f7a04847 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:33.087665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d882d23-bec6-4f97-81a8-81b69b1e50af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:33.088306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882d23-bec6-4f97-81a8-81b69b1e50af admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:33.088588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882d23-bec6-4f97-81a8-81b69b1e50af admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:33.088862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882d23-bec6-4f97-81a8-81b69b1e50af admin admin] PATH_INFO: `/v3/projects/7bfd5fc4dea64ded8128426ec3f5dc11/users/cad1e057597140cea83397a883eb3f1c/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:33.104067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d882d23-bec6-4f97-81a8-81b69b1e50af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfd5fc4dea64ded8128426ec3f5dc11, user_id=cad1e057597140cea83397a883eb3f1c, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:33.106779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d882d23-bec6-4f97-81a8-81b69b1e50af admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:33.109035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:33.168519 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1308/2579] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:33 2022] PUT /identity/v3/projects/7bfd5fc4dea64ded8128426ec3f5dc11/users/cad1e057597140cea83397a883eb3f1c/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:06:33.173369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c589c9b-686c-410d-83be-4095aeda9bb0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:33.183515 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c589c9b-686c-410d-83be-4095aeda9bb0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:33.223126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:33.239394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39725e-8645-435a-a522-a805fcb90ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:33.240001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39725e-8645-435a-a522-a805fcb90ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:33.240285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39725e-8645-435a-a522-a805fcb90ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:33.240561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39725e-8645-435a-a522-a805fcb90ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:33.241209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39725e-8645-435a-a522-a805fcb90ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:33.242836 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39725e-8645-435a-a522-a805fcb90ad6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:33.252297 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1272/2580] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:33.256600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d882d23-bec6-4f97-81a8-81b69b1e50af admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:33.266810 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d882d23-bec6-4f97-81a8-81b69b1e50af admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:33.271563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3675f8-52d3-4b05-abd8-9d7149c8fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:33.272199 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3675f8-52d3-4b05-abd8-9d7149c8fc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:33.272479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3675f8-52d3-4b05-abd8-9d7149c8fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:33.272755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3675f8-52d3-4b05-abd8-9d7149c8fc57 admin admin] PATH_INFO: `/v3/projects/7bfd5fc4dea64ded8128426ec3f5dc11/users/cad1e057597140cea83397a883eb3f1c/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:33.275165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3675f8-52d3-4b05-abd8-9d7149c8fc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfd5fc4dea64ded8128426ec3f5dc11, user_id=cad1e057597140cea83397a883eb3f1c, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:33.277429 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3675f8-52d3-4b05-abd8-9d7149c8fc57 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:33.288027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1309/2581] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:33 2022] PUT /identity/v3/projects/7bfd5fc4dea64ded8128426ec3f5dc11/users/cad1e057597140cea83397a883eb3f1c/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:33.300118 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e2661-817f-4602-bd08-3196e252e803 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:33.300409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e2661-817f-4602-bd08-3196e252e803 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:33.300687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e2661-817f-4602-bd08-3196e252e803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:33.327545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5e5e2661-817f-4602-bd08-3196e252e803 None None] MFA Rules not processed for user `cad1e057597140cea83397a883eb3f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:33.329277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5e5e2661-817f-4602-bd08-3196e252e803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:33.396984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1273/2582] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:33.408620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3675f8-52d3-4b05-abd8-9d7149c8fc57 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:33.410347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ee3675f8-52d3-4b05-abd8-9d7149c8fc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:33.466476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3675f8-52d3-4b05-abd8-9d7149c8fc57 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:33.470774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e8ff-eb3e-4feb-a94c-9f35c1d65016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:33.471370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e8ff-eb3e-4feb-a94c-9f35c1d65016 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:33.471651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e8ff-eb3e-4feb-a94c-9f35c1d65016 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:33.471924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e8ff-eb3e-4feb-a94c-9f35c1d65016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:33.480757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4e8ff-eb3e-4feb-a94c-9f35c1d65016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:33.482225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4e8ff-eb3e-4feb-a94c-9f35c1d65016 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:33.491535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1310/2583] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:33.519728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e2661-817f-4602-bd08-3196e252e803 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:33.579599 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e2661-817f-4602-bd08-3196e252e803 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:33.584135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:33.584755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:33.585035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:33.585306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] PATH_INFO: `/v3/users/3bef1cb31678411dbac0fe3d89f9ec36` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:33.586444 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bef1cb31678411dbac0fe3d89f9ec36)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:33.588357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:33.774649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bef1cb31678411dbac0fe3d89f9ec36'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:33.775229 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bef1cb31678411dbac0fe3d89f9ec36'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:33.782046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bef1cb31678411dbac0fe3d89f9ec36'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:33.782780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bef1cb31678411dbac0fe3d89f9ec36'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:33.789691 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:33.795222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bef1cb31678411dbac0fe3d89f9ec36'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:33.859236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1274/2584] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:33 2022] DELETE /identity/v3/users/3bef1cb31678411dbac0fe3d89f9ec36 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:33.863831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4ce8-50d6-4a86-b6ee-a2cd6996b157 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:33.864178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4ce8-50d6-4a86-b6ee-a2cd6996b157 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:33.864407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e4ce8-50d6-4a86-b6ee-a2cd6996b157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:33.883638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0d5e4ce8-50d6-4a86-b6ee-a2cd6996b157 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:33.884838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0d5e4ce8-50d6-4a86-b6ee-a2cd6996b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:33.945857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1311/2585] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:33.956384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:33.957875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:34.014087 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de30403-6074-454f-9e86-fd44fe06412f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:34.018392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f98d6-6591-44f7-a4d4-8642926c3798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:34.018995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f98d6-6591-44f7-a4d4-8642926c3798 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:34.019279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f98d6-6591-44f7-a4d4-8642926c3798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:34.019555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f98d6-6591-44f7-a4d4-8642926c3798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:34.028368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f98d6-6591-44f7-a4d4-8642926c3798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:34.029720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f98d6-6591-44f7-a4d4-8642926c3798 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:34.039109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1275/2586] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:34.450191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4ce8-50d6-4a86-b6ee-a2cd6996b157 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:34.451654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0d5e4ce8-50d6-4a86-b6ee-a2cd6996b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:34.464591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e4ce8-50d6-4a86-b6ee-a2cd6996b157 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:34.469225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:34.470400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:34.470821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:34.471100 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] PATH_INFO: `/v3/projects/7f970e83129543ee8b086e0cbb60d56d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:34.472237 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f970e83129543ee8b086e0cbb60d56d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:34.474197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:34.577078 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f970e83129543ee8b086e0cbb60d56d', 'request_id': 'req-5bd09415-a1ce-4552-9535-8c17d8a52f5d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.583388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f970e83129543ee8b086e0cbb60d56d', 'request_id': 'req-5bd09415-a1ce-4552-9535-8c17d8a52f5d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.631530 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f970e83129543ee8b086e0cbb60d56d', 'request_id': 'req-5bd09415-a1ce-4552-9535-8c17d8a52f5d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.642049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] The token cache is being invalidate because project 7f970e83129543ee8b086e0cbb60d56d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:34.642372 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.643005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.644503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1312/2587] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:34 2022] DELETE /identity/v3/projects/7f970e83129543ee8b086e0cbb60d56d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:34.648580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f98d6-6591-44f7-a4d4-8642926c3798 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:34.658709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f98d6-6591-44f7-a4d4-8642926c3798 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:34.713002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:34.713633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:34.713914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:34.714293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] PATH_INFO: `/v3/users/cad1e057597140cea83397a883eb3f1c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:34.715433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cad1e057597140cea83397a883eb3f1c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:34.717335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:34.867547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cad1e057597140cea83397a883eb3f1c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.868204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cad1e057597140cea83397a883eb3f1c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.875176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cad1e057597140cea83397a883eb3f1c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.875831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cad1e057597140cea83397a883eb3f1c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.887688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-81b607a9-8485-4944-b731-95719a0cf25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cad1e057597140cea83397a883eb3f1c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:34.951385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1276/2588] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:34 2022] DELETE /identity/v3/users/cad1e057597140cea83397a883eb3f1c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:35.353516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:35.355079 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:35.374030 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd09415-a1ce-4552-9535-8c17d8a52f5d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:35.378685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:35.433151 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:35.433701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:35.434110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:35.434510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] PATH_INFO: `/v3/projects/7bfd5fc4dea64ded8128426ec3f5dc11` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:35.435631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfd5fc4dea64ded8128426ec3f5dc11)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:35.437572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:35.551647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfd5fc4dea64ded8128426ec3f5dc11', 'request_id': 'req-a53028d0-a5e2-4212-a418-cedd07faefc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:35.557995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfd5fc4dea64ded8128426ec3f5dc11', 'request_id': 'req-a53028d0-a5e2-4212-a418-cedd07faefc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:35.648276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfd5fc4dea64ded8128426ec3f5dc11', 'request_id': 'req-a53028d0-a5e2-4212-a418-cedd07faefc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:35.659568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] The token cache is being invalidate because project 7bfd5fc4dea64ded8128426ec3f5dc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:35.659838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:35.660474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a53028d0-a5e2-4212-a418-cedd07faefc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:35.661961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1313/2589] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:35 2022] DELETE /identity/v3/projects/7bfd5fc4dea64ded8128426ec3f5dc11 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:35.666863 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ca1b8-bde6-4037-82be-5fb2e731c0f1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:35.667145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ca1b8-bde6-4037-82be-5fb2e731c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:35.667418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ca1b8-bde6-4037-82be-5fb2e731c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:35.676090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:35.686827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-046ca1b8-bde6-4037-82be-5fb2e731c0f1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:35.687958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-046ca1b8-bde6-4037-82be-5fb2e731c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:35.744664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1277/2590] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:06:35.752302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ac0f4-8da0-4d4a-8f99-fa3b3c2550c2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:35.752591 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ac0f4-8da0-4d4a-8f99-fa3b3c2550c2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:35.752869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ac0f4-8da0-4d4a-8f99-fa3b3c2550c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:35.772604 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6c0ac0f4-8da0-4d4a-8f99-fa3b3c2550c2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:35.773798 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6c0ac0f4-8da0-4d4a-8f99-fa3b3c2550c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:35.781595 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1314/2591] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:06:35.786346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ca1b8-bde6-4037-82be-5fb2e731c0f1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:35.796029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ca1b8-bde6-4037-82be-5fb2e731c0f1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:35.800439 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79fd08-dc41-4e9f-b704-ece0d41561a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:35.801035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79fd08-dc41-4e9f-b704-ece0d41561a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:35.801316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79fd08-dc41-4e9f-b704-ece0d41561a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:35.801589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79fd08-dc41-4e9f-b704-ece0d41561a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:35.802266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79fd08-dc41-4e9f-b704-ece0d41561a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:06:35.802569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79fd08-dc41-4e9f-b704-ece0d41561a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:35.804153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79fd08-dc41-4e9f-b704-ece0d41561a1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:35.815677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1278/2592] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:06:35.819828 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ac0f4-8da0-4d4a-8f99-fa3b3c2550c2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:35.829617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ac0f4-8da0-4d4a-8f99-fa3b3c2550c2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:35.834340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f5f8e-5867-4d72-8d09-1680534a18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:35.834932 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f5f8e-5867-4d72-8d09-1680534a18cb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:35.835210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f5f8e-5867-4d72-8d09-1680534a18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:35.835481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f5f8e-5867-4d72-8d09-1680534a18cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:35.836140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f5f8e-5867-4d72-8d09-1680534a18cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:35.838101 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f5f8e-5867-4d72-8d09-1680534a18cb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:35.925804 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1315/2593] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:35 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:35.928071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79fd08-dc41-4e9f-b704-ece0d41561a1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:35.943290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79fd08-dc41-4e9f-b704-ece0d41561a1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:35.994941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84141d-ac36-4a42-966c-3ab66a08bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:35.995539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84141d-ac36-4a42-966c-3ab66a08bc00 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:35.995822 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84141d-ac36-4a42-966c-3ab66a08bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:35.996097 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84141d-ac36-4a42-966c-3ab66a08bc00 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:35.996725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84141d-ac36-4a42-966c-3ab66a08bc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:35.998681 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84141d-ac36-4a42-966c-3ab66a08bc00 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.082222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1279/2594] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:35 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:36.086460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f5f8e-5867-4d72-8d09-1680534a18cb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:36.096731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f5f8e-5867-4d72-8d09-1680534a18cb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:36.101327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae245ce-db79-4911-83ec-d5b534e8e5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:36.101919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae245ce-db79-4911-83ec-d5b534e8e5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.102236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae245ce-db79-4911-83ec-d5b534e8e5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.102513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae245ce-db79-4911-83ec-d5b534e8e5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.103232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae245ce-db79-4911-83ec-d5b534e8e5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:36.104833 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae245ce-db79-4911-83ec-d5b534e8e5f2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.114672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1316/2595] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:36.118500 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84141d-ac36-4a42-966c-3ab66a08bc00 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:36.128773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84141d-ac36-4a42-966c-3ab66a08bc00 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:36.133316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4e909-9e05-4b36-94b9-2dd3c8bd60c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:36.133907 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e909-9e05-4b36-94b9-2dd3c8bd60c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.134232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e909-9e05-4b36-94b9-2dd3c8bd60c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.134511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e909-9e05-4b36-94b9-2dd3c8bd60c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.135187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4e909-9e05-4b36-94b9-2dd3c8bd60c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:36.136798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4e909-9e05-4b36-94b9-2dd3c8bd60c4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.147566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1280/2596] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:36.151538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae245ce-db79-4911-83ec-d5b534e8e5f2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:36.161407 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae245ce-db79-4911-83ec-d5b534e8e5f2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:36.166181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905a00f-09c9-439f-95e5-e370a2686eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:36.166811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905a00f-09c9-439f-95e5-e370a2686eee admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.167089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905a00f-09c9-439f-95e5-e370a2686eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.167360 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905a00f-09c9-439f-95e5-e370a2686eee admin admin] PATH_INFO: `/v3/projects/3900d43ecedc428d99491c81a1d66064/users/cd14331d80b740a2a083614f6c185117/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.181942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905a00f-09c9-439f-95e5-e370a2686eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3900d43ecedc428d99491c81a1d66064, user_id=cd14331d80b740a2a083614f6c185117, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:36.184663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905a00f-09c9-439f-95e5-e370a2686eee admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.284638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1317/2597] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:36 2022] PUT /identity/v3/projects/3900d43ecedc428d99491c81a1d66064/users/cd14331d80b740a2a083614f6c185117/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:06:36.287554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc087242-0959-41a4-b6b1-de9ec6863133 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.287872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc087242-0959-41a4-b6b1-de9ec6863133 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.288148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc087242-0959-41a4-b6b1-de9ec6863133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.316945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dc087242-0959-41a4-b6b1-de9ec6863133 None None] MFA Rules not processed for user `cd14331d80b740a2a083614f6c185117`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:36.318177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dc087242-0959-41a4-b6b1-de9ec6863133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:36.378598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:36.382588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1281/2598] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:36.387194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905a00f-09c9-439f-95e5-e370a2686eee admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:36.421989 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:36.449829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905a00f-09c9-439f-95e5-e370a2686eee admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:36.454593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88609712-7675-4292-ad12-f3460b94766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:36.455198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88609712-7675-4292-ad12-f3460b94766e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.455481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88609712-7675-4292-ad12-f3460b94766e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.455769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88609712-7675-4292-ad12-f3460b94766e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.456385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88609712-7675-4292-ad12-f3460b94766e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:36.458424 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88609712-7675-4292-ad12-f3460b94766e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.556945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1318/2599] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:36 2022] POST /identity/v3/projects => generated 391 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:06:36.560885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc087242-0959-41a4-b6b1-de9ec6863133 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:36.572348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc087242-0959-41a4-b6b1-de9ec6863133 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:36.627840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04b63f-caca-447e-993d-4c259c00b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:36.628430 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04b63f-caca-447e-993d-4c259c00b2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.628715 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04b63f-caca-447e-993d-4c259c00b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.628994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04b63f-caca-447e-993d-4c259c00b2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.629657 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04b63f-caca-447e-993d-4c259c00b2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:36.631605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04b63f-caca-447e-993d-4c259c00b2b0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.711279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1282/2600] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:36 2022] POST /identity/v3/users => generated 302 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:36.715090 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88609712-7675-4292-ad12-f3460b94766e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:36.725793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88609712-7675-4292-ad12-f3460b94766e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:36.732318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8319a-8950-4044-81aa-925f06ff74bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:36.732318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8319a-8950-4044-81aa-925f06ff74bd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.732318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8319a-8950-4044-81aa-925f06ff74bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.732318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8319a-8950-4044-81aa-925f06ff74bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.732672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8319a-8950-4044-81aa-925f06ff74bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:36.733866 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8319a-8950-4044-81aa-925f06ff74bd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.744513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1319/2601] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:06:36.748550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04b63f-caca-447e-993d-4c259c00b2b0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:36.758394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04b63f-caca-447e-993d-4c259c00b2b0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:36.763021 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64178f9-9282-452b-b5d6-d7030bd2e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:36.763664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64178f9-9282-452b-b5d6-d7030bd2e525 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.763943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64178f9-9282-452b-b5d6-d7030bd2e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.764216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64178f9-9282-452b-b5d6-d7030bd2e525 admin admin] PATH_INFO: `/v3/projects/db177a70d5de4433bc68f1099a4b23ff/users/ed18a43ceaf0406a9456855c7c7992a5/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.778724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64178f9-9282-452b-b5d6-d7030bd2e525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db177a70d5de4433bc68f1099a4b23ff, user_id=ed18a43ceaf0406a9456855c7c7992a5, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:36.781346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64178f9-9282-452b-b5d6-d7030bd2e525 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.836586 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1283/2602] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:36 2022] PUT /identity/v3/projects/db177a70d5de4433bc68f1099a4b23ff/users/ed18a43ceaf0406a9456855c7c7992a5/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:36.840428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8319a-8950-4044-81aa-925f06ff74bd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:36.851163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8319a-8950-4044-81aa-925f06ff74bd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:36.906233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c070e-3c7b-42a7-b281-104ab7c4092e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:36.906920 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c070e-3c7b-42a7-b281-104ab7c4092e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.907218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c070e-3c7b-42a7-b281-104ab7c4092e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.907496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c070e-3c7b-42a7-b281-104ab7c4092e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.908132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c070e-3c7b-42a7-b281-104ab7c4092e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:36.910231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c070e-3c7b-42a7-b281-104ab7c4092e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.920223 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1320/2603] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:36.925100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64178f9-9282-452b-b5d6-d7030bd2e525 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:36.935572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64178f9-9282-452b-b5d6-d7030bd2e525 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:36.940318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158a86b-dee4-4857-a942-57e69529bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:36.941039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158a86b-dee4-4857-a942-57e69529bb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.941319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158a86b-dee4-4857-a942-57e69529bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.941592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158a86b-dee4-4857-a942-57e69529bb50 admin admin] PATH_INFO: `/v3/projects/db177a70d5de4433bc68f1099a4b23ff/users/ed18a43ceaf0406a9456855c7c7992a5/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.943542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158a86b-dee4-4857-a942-57e69529bb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db177a70d5de4433bc68f1099a4b23ff, user_id=ed18a43ceaf0406a9456855c7c7992a5, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:36.946179 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158a86b-dee4-4857-a942-57e69529bb50 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:36.956820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1284/2604] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:36 2022] PUT /identity/v3/projects/db177a70d5de4433bc68f1099a4b23ff/users/ed18a43ceaf0406a9456855c7c7992a5/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:36.968204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca6f6f-3c9e-4ce1-8704-64f7abf6b782 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:36.968494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca6f6f-3c9e-4ce1-8704-64f7abf6b782 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:36.968768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca6f6f-3c9e-4ce1-8704-64f7abf6b782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:36.997036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eaca6f6f-3c9e-4ce1-8704-64f7abf6b782 None None] MFA Rules not processed for user `ed18a43ceaf0406a9456855c7c7992a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:36.998296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eaca6f6f-3c9e-4ce1-8704-64f7abf6b782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:37.064912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1321/2605] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:37.075663 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158a86b-dee4-4857-a942-57e69529bb50 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:37.077365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c158a86b-dee4-4857-a942-57e69529bb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:37.255970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158a86b-dee4-4857-a942-57e69529bb50 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:37.259588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f849e-6c48-46c6-a9f5-ff217a7db3d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:37.260166 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f849e-6c48-46c6-a9f5-ff217a7db3d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:37.260443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f849e-6c48-46c6-a9f5-ff217a7db3d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:37.260713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f849e-6c48-46c6-a9f5-ff217a7db3d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:37.269835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f849e-6c48-46c6-a9f5-ff217a7db3d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:37.271275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f849e-6c48-46c6-a9f5-ff217a7db3d5 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:37.280387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1285/2606] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:37.326665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca6f6f-3c9e-4ce1-8704-64f7abf6b782 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:37.328062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eaca6f6f-3c9e-4ce1-8704-64f7abf6b782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:37.340175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca6f6f-3c9e-4ce1-8704-64f7abf6b782 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:37.343712 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d392e10-c215-4495-99ea-405227ccd075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:37.344298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392e10-c215-4495-99ea-405227ccd075 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:37.344576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392e10-c215-4495-99ea-405227ccd075 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:37.344847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392e10-c215-4495-99ea-405227ccd075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:37.370965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:37.402981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d392e10-c215-4495-99ea-405227ccd075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:37.404432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d392e10-c215-4495-99ea-405227ccd075 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:37.413803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1322/2607] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:42.027854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f849e-6c48-46c6-a9f5-ff217a7db3d5 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:42.084424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:42.089745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f849e-6c48-46c6-a9f5-ff217a7db3d5 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:42.094378 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:42.095003 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:42.095283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:42.095561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] PATH_INFO: `/v3/users/cd14331d80b740a2a083614f6c185117` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:42.097172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd14331d80b740a2a083614f6c185117)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:42.099160 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:42.245403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd14331d80b740a2a083614f6c185117'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:42.246036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd14331d80b740a2a083614f6c185117'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:42.252984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd14331d80b740a2a083614f6c185117'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:42.253615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd14331d80b740a2a083614f6c185117'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:42.265328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd14331d80b740a2a083614f6c185117'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:42.310222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1286/2608] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:42 2022] DELETE /identity/v3/users/cd14331d80b740a2a083614f6c185117 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:42.314776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5952dba-6314-4148-a054-b447d3c449b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:42.318382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5952dba-6314-4148-a054-b447d3c449b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:42.318382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5952dba-6314-4148-a054-b447d3c449b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:42.335011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d5952dba-6314-4148-a054-b447d3c449b2 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:42.336246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d5952dba-6314-4148-a054-b447d3c449b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:42.396430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1323/2609] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:42.406195 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:42.407553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:42.465620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00030848-8e2b-4eeb-9eb7-8e5a756032ce admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:42.469674 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116f32d-7626-4426-866d-27fbdc96be6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:42.470333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f32d-7626-4426-866d-27fbdc96be6c service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:42.470615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f32d-7626-4426-866d-27fbdc96be6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:42.471458 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116f32d-7626-4426-866d-27fbdc96be6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:42.481245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116f32d-7626-4426-866d-27fbdc96be6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:42.482753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116f32d-7626-4426-866d-27fbdc96be6c service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:42.492184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1287/2610] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:42.893473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5952dba-6314-4148-a054-b447d3c449b2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:42.895121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d5952dba-6314-4148-a054-b447d3c449b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:42.908393 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5952dba-6314-4148-a054-b447d3c449b2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:42.912477 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:42.913222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:42.913406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:42.913617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] PATH_INFO: `/v3/projects/3900d43ecedc428d99491c81a1d66064` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:42.915083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3900d43ecedc428d99491c81a1d66064)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:42.917196 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:43.081776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3900d43ecedc428d99491c81a1d66064', 'request_id': 'req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.088241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3900d43ecedc428d99491c81a1d66064', 'request_id': 'req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.150836 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3900d43ecedc428d99491c81a1d66064', 'request_id': 'req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.161739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] The token cache is being invalidate because project 3900d43ecedc428d99491c81a1d66064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:43.162041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.162697 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.164177 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1324/2611] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:42 2022] DELETE /identity/v3/projects/3900d43ecedc428d99491c81a1d66064 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:06:43.168168 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116f32d-7626-4426-866d-27fbdc96be6c service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:43.178558 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116f32d-7626-4426-866d-27fbdc96be6c service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:43.232713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:43.233382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:43.233667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:43.233945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] PATH_INFO: `/v3/users/ed18a43ceaf0406a9456855c7c7992a5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:43.235161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed18a43ceaf0406a9456855c7c7992a5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:43.237719 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:43.259017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:43.439895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed18a43ceaf0406a9456855c7c7992a5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.440556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed18a43ceaf0406a9456855c7c7992a5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.447690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed18a43ceaf0406a9456855c7c7992a5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.448354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed18a43ceaf0406a9456855c7c7992a5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.460397 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5893e825-1b89-4932-b6ad-521069d8995c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed18a43ceaf0406a9456855c7c7992a5'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:43.521811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1288/2612] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:43 2022] DELETE /identity/v3/users/ed18a43ceaf0406a9456855c7c7992a5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:43.906709 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:43.908240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:43.922517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5227fc-126a-46a6-b17f-c8741ec1bb5b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:43.973109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:43.983187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:43.983822 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:43.984105 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:43.984386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] PATH_INFO: `/v3/projects/db177a70d5de4433bc68f1099a4b23ff` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:43.985548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db177a70d5de4433bc68f1099a4b23ff)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:43.987488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:44.080715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db177a70d5de4433bc68f1099a4b23ff', 'request_id': 'req-0aa00c11-0997-4a16-9ce0-2e387600e9a7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:44.087817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db177a70d5de4433bc68f1099a4b23ff', 'request_id': 'req-0aa00c11-0997-4a16-9ce0-2e387600e9a7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:44.172430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db177a70d5de4433bc68f1099a4b23ff', 'request_id': 'req-0aa00c11-0997-4a16-9ce0-2e387600e9a7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:44.183052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] The token cache is being invalidate because project db177a70d5de4433bc68f1099a4b23ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:44.183338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:44.183957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0aa00c11-0997-4a16-9ce0-2e387600e9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:44.185451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1325/2613] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:43 2022] DELETE /identity/v3/projects/db177a70d5de4433bc68f1099a4b23ff => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:44.190350 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81583-c732-480e-8085-7093a94435c9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.190831 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81583-c732-480e-8085-7093a94435c9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.190937 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81583-c732-480e-8085-7093a94435c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.211452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-30a81583-c732-480e-8085-7093a94435c9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:44.212665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-30a81583-c732-480e-8085-7093a94435c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:44.269359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1289/2614] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:44.277901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265cf0b-0bda-4db5-a9b9-171b3d865d5c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.278231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265cf0b-0bda-4db5-a9b9-171b3d865d5c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.278510 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265cf0b-0bda-4db5-a9b9-171b3d865d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.298206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4265cf0b-0bda-4db5-a9b9-171b3d865d5c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:44.299420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4265cf0b-0bda-4db5-a9b9-171b3d865d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:44.307194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1326/2615] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:44.311283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81583-c732-480e-8085-7093a94435c9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:44.321258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81583-c732-480e-8085-7093a94435c9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:44.325762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c16e7b-5fd3-4dfd-9af2-17da77dbba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:44.326384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c16e7b-5fd3-4dfd-9af2-17da77dbba65 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.326667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c16e7b-5fd3-4dfd-9af2-17da77dbba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.326939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c16e7b-5fd3-4dfd-9af2-17da77dbba65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.327580 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c16e7b-5fd3-4dfd-9af2-17da77dbba65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:06:44.327880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c16e7b-5fd3-4dfd-9af2-17da77dbba65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:44.329455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c16e7b-5fd3-4dfd-9af2-17da77dbba65 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:44.341037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1290/2616] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:06:44.345051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265cf0b-0bda-4db5-a9b9-171b3d865d5c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:44.354274 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265cf0b-0bda-4db5-a9b9-171b3d865d5c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:44.358868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93a25-0860-4675-a782-8b21ff7dc63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:44.359452 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93a25-0860-4675-a782-8b21ff7dc63e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.359734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93a25-0860-4675-a782-8b21ff7dc63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.360008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db93a25-0860-4675-a782-8b21ff7dc63e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.360642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db93a25-0860-4675-a782-8b21ff7dc63e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:44.362581 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db93a25-0860-4675-a782-8b21ff7dc63e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:44.466230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1327/2617] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:44 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:44.471475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c16e7b-5fd3-4dfd-9af2-17da77dbba65 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:44.481634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c16e7b-5fd3-4dfd-9af2-17da77dbba65 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:44.536697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd41b4-2de2-4842-925f-82ce81af52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:44.537230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd41b4-2de2-4842-925f-82ce81af52ce admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.537513 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd41b4-2de2-4842-925f-82ce81af52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.537790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd41b4-2de2-4842-925f-82ce81af52ce admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.538461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd41b4-2de2-4842-925f-82ce81af52ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:44.540369 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd41b4-2de2-4842-925f-82ce81af52ce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:44.627315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1291/2618] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:44 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:44.628533 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93a25-0860-4675-a782-8b21ff7dc63e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:44.641019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db93a25-0860-4675-a782-8b21ff7dc63e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:44.645795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2298fb-546a-4f8f-9d4e-3503f229c965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:44.646299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2298fb-546a-4f8f-9d4e-3503f229c965 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.646582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2298fb-546a-4f8f-9d4e-3503f229c965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.646853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2298fb-546a-4f8f-9d4e-3503f229c965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.647495 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2298fb-546a-4f8f-9d4e-3503f229c965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:44.649287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2298fb-546a-4f8f-9d4e-3503f229c965 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:44.659448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1328/2619] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:44.663377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd41b4-2de2-4842-925f-82ce81af52ce admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:44.673629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd41b4-2de2-4842-925f-82ce81af52ce admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:44.678815 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99606f1b-1995-4d83-be73-aad5fec27fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:44.679441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99606f1b-1995-4d83-be73-aad5fec27fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.679728 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99606f1b-1995-4d83-be73-aad5fec27fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.680004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99606f1b-1995-4d83-be73-aad5fec27fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.680657 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99606f1b-1995-4d83-be73-aad5fec27fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:44.682275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99606f1b-1995-4d83-be73-aad5fec27fb6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:44.692594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1292/2620] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:44.697488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2298fb-546a-4f8f-9d4e-3503f229c965 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:44.707206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2298fb-546a-4f8f-9d4e-3503f229c965 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:44.712038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41c8e-fdc8-43c5-9b6f-34fd56ea014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:44.712718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41c8e-fdc8-43c5-9b6f-34fd56ea014b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.713001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41c8e-fdc8-43c5-9b6f-34fd56ea014b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.713383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41c8e-fdc8-43c5-9b6f-34fd56ea014b admin admin] PATH_INFO: `/v3/projects/89f68110f8d9435290167176beef83d7/users/877314069cbd45a5a4bbf98f8466b614/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.728271 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe41c8e-fdc8-43c5-9b6f-34fd56ea014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f68110f8d9435290167176beef83d7, user_id=877314069cbd45a5a4bbf98f8466b614, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:44.731038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe41c8e-fdc8-43c5-9b6f-34fd56ea014b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:44.785354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1329/2621] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:44 2022] PUT /identity/v3/projects/89f68110f8d9435290167176beef83d7/users/877314069cbd45a5a4bbf98f8466b614/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:06:44.797071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb1fe-6519-47c1-87b1-5954ad697c49 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.797304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb1fe-6519-47c1-87b1-5954ad697c49 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.797587 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb1fe-6519-47c1-87b1-5954ad697c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.805267 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:44.826504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f3cfb1fe-6519-47c1-87b1-5954ad697c49 None None] MFA Rules not processed for user `877314069cbd45a5a4bbf98f8466b614`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:44.827721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f3cfb1fe-6519-47c1-87b1-5954ad697c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:44.891605 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1293/2622] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:44.896140 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41c8e-fdc8-43c5-9b6f-34fd56ea014b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:44.964818 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe41c8e-fdc8-43c5-9b6f-34fd56ea014b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:44.969646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd635ea-78c1-4ad6-89f9-78e4656cfb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:44.970283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd635ea-78c1-4ad6-89f9-78e4656cfb85 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:44.970561 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd635ea-78c1-4ad6-89f9-78e4656cfb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:44.970874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd635ea-78c1-4ad6-89f9-78e4656cfb85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:44.971511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd635ea-78c1-4ad6-89f9-78e4656cfb85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:44.974017 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd635ea-78c1-4ad6-89f9-78e4656cfb85 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:45.057136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1330/2623] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:44 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:45.060974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb1fe-6519-47c1-87b1-5954ad697c49 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:45.072123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb1fe-6519-47c1-87b1-5954ad697c49 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:45.142669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc3ed3-2020-412f-b4fe-63da5318ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:45.143292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc3ed3-2020-412f-b4fe-63da5318ef04 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:45.143569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc3ed3-2020-412f-b4fe-63da5318ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:45.143839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc3ed3-2020-412f-b4fe-63da5318ef04 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:45.144494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc3ed3-2020-412f-b4fe-63da5318ef04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:45.146469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc3ed3-2020-412f-b4fe-63da5318ef04 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:45.241562 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1294/2624] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:45 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:06:45.247117 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd635ea-78c1-4ad6-89f9-78e4656cfb85 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:45.252762 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:45.258127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd635ea-78c1-4ad6-89f9-78e4656cfb85 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:45.262719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36910-256c-4702-a691-d7febf62f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:45.263316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36910-256c-4702-a691-d7febf62f64a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:45.263602 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36910-256c-4702-a691-d7febf62f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:45.263875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b36910-256c-4702-a691-d7febf62f64a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:45.264524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b36910-256c-4702-a691-d7febf62f64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:45.266150 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b36910-256c-4702-a691-d7febf62f64a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:45.276961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1331/2625] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:45.280962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc3ed3-2020-412f-b4fe-63da5318ef04 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:45.291341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc3ed3-2020-412f-b4fe-63da5318ef04 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:45.296216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa361e34-3b88-4080-9005-e826bfa91001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:45.298853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa361e34-3b88-4080-9005-e826bfa91001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:45.298853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa361e34-3b88-4080-9005-e826bfa91001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:45.298853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa361e34-3b88-4080-9005-e826bfa91001 admin admin] PATH_INFO: `/v3/projects/b91fa1b2aba844b08617b109084e9b26/users/08d7f4b3ed014eeea3e611c29b6b6320/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:45.311943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa361e34-3b88-4080-9005-e826bfa91001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91fa1b2aba844b08617b109084e9b26, user_id=08d7f4b3ed014eeea3e611c29b6b6320, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:45.314527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa361e34-3b88-4080-9005-e826bfa91001 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:45.389781 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1295/2626] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:45 2022] PUT /identity/v3/projects/b91fa1b2aba844b08617b109084e9b26/users/08d7f4b3ed014eeea3e611c29b6b6320/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:45.393690 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36910-256c-4702-a691-d7febf62f64a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:45.405141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b36910-256c-4702-a691-d7febf62f64a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:45.459692 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fea8e-970b-4e2a-b288-bea9eddfd1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:45.460296 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fea8e-970b-4e2a-b288-bea9eddfd1ef admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:45.460578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fea8e-970b-4e2a-b288-bea9eddfd1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:45.460852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fea8e-970b-4e2a-b288-bea9eddfd1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:45.461493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fea8e-970b-4e2a-b288-bea9eddfd1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:45.463149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fea8e-970b-4e2a-b288-bea9eddfd1ef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:45.473430 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1332/2627] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:45.477534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa361e34-3b88-4080-9005-e826bfa91001 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:45.487753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa361e34-3b88-4080-9005-e826bfa91001 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:45.492357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ebb5c-dfbb-4c97-8afb-02449225668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:45.493000 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ebb5c-dfbb-4c97-8afb-02449225668f admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:45.493281 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ebb5c-dfbb-4c97-8afb-02449225668f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:45.493554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ebb5c-dfbb-4c97-8afb-02449225668f admin admin] PATH_INFO: `/v3/projects/b91fa1b2aba844b08617b109084e9b26/users/08d7f4b3ed014eeea3e611c29b6b6320/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:45.495542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ebb5c-dfbb-4c97-8afb-02449225668f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91fa1b2aba844b08617b109084e9b26, user_id=08d7f4b3ed014eeea3e611c29b6b6320, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:45.498164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ebb5c-dfbb-4c97-8afb-02449225668f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:45.508405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1296/2628] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:45 2022] PUT /identity/v3/projects/b91fa1b2aba844b08617b109084e9b26/users/08d7f4b3ed014eeea3e611c29b6b6320/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:45.518552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f275d19-f2df-48ab-8e58-eba4ef1213c5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:45.518842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f275d19-f2df-48ab-8e58-eba4ef1213c5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:45.519665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f275d19-f2df-48ab-8e58-eba4ef1213c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:45.548000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7f275d19-f2df-48ab-8e58-eba4ef1213c5 None None] MFA Rules not processed for user `08d7f4b3ed014eeea3e611c29b6b6320`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:45.549194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7f275d19-f2df-48ab-8e58-eba4ef1213c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:45.614898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1333/2629] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:45.625648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ebb5c-dfbb-4c97-8afb-02449225668f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:45.627354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-746ebb5c-dfbb-4c97-8afb-02449225668f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:45.672793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:45.682771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ebb5c-dfbb-4c97-8afb-02449225668f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:45.690035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b9ee0-14c2-46c7-9b56-5aebc20a5685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:45.690035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9ee0-14c2-46c7-9b56-5aebc20a5685 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:45.690035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9ee0-14c2-46c7-9b56-5aebc20a5685 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:45.690035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b9ee0-14c2-46c7-9b56-5aebc20a5685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:45.696510 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b9ee0-14c2-46c7-9b56-5aebc20a5685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:45.697919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b9ee0-14c2-46c7-9b56-5aebc20a5685 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:45.707697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1297/2630] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:46.737332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f275d19-f2df-48ab-8e58-eba4ef1213c5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:46.798053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f275d19-f2df-48ab-8e58-eba4ef1213c5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:46.802590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:46.803209 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:46.803488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:46.803760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] PATH_INFO: `/v3/users/877314069cbd45a5a4bbf98f8466b614` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:46.804874 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] RBAC: Authorizing `identity:delete_user(user_id=877314069cbd45a5a4bbf98f8466b614)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:46.806830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:46.819796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:46.932300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877314069cbd45a5a4bbf98f8466b614'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:46.933050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877314069cbd45a5a4bbf98f8466b614'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:46.941644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877314069cbd45a5a4bbf98f8466b614'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:47.030889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877314069cbd45a5a4bbf98f8466b614'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:47.031483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877314069cbd45a5a4bbf98f8466b614'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:47.050182 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1334/2631] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:46 2022] DELETE /identity/v3/users/877314069cbd45a5a4bbf98f8466b614 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:47.054646 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1c84e-e478-42f6-b7be-ce4863efbc43 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:47.055128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1c84e-e478-42f6-b7be-ce4863efbc43 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:47.055227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1c84e-e478-42f6-b7be-ce4863efbc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:47.074047 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-96b1c84e-e478-42f6-b7be-ce4863efbc43 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:47.075289 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-96b1c84e-e478-42f6-b7be-ce4863efbc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:47.132713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1298/2632] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:47.142357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:47.143768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:47.200254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e024aa9-9f5c-4a6d-be20-f42fd5b0647a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:47.203912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6675b9-9802-440e-9438-a9bd0ba002d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:47.204517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6675b9-9802-440e-9438-a9bd0ba002d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:47.204801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6675b9-9802-440e-9438-a9bd0ba002d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:47.205080 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6675b9-9802-440e-9438-a9bd0ba002d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:47.214976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6675b9-9802-440e-9438-a9bd0ba002d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:47.216474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6675b9-9802-440e-9438-a9bd0ba002d4 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:47.226000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1335/2633] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:47.729442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1c84e-e478-42f6-b7be-ce4863efbc43 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:47.730876 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-96b1c84e-e478-42f6-b7be-ce4863efbc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:47.744296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1c84e-e478-42f6-b7be-ce4863efbc43 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:47.748827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:47.749501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:47.749783 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:47.750055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] PATH_INFO: `/v3/projects/89f68110f8d9435290167176beef83d7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:47.751967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f68110f8d9435290167176beef83d7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:47.753851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:47.852936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f68110f8d9435290167176beef83d7', 'request_id': 'req-902e0f90-3711-4b4e-b5fc-ddec91f75952'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:47.858936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f68110f8d9435290167176beef83d7', 'request_id': 'req-902e0f90-3711-4b4e-b5fc-ddec91f75952'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:47.864356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f68110f8d9435290167176beef83d7', 'request_id': 'req-902e0f90-3711-4b4e-b5fc-ddec91f75952'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:47.921321 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] The token cache is being invalidate because project 89f68110f8d9435290167176beef83d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:47.921609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:47.922249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:47.923755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1299/2634] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:47 2022] DELETE /identity/v3/projects/89f68110f8d9435290167176beef83d7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:47.928515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6675b9-9802-440e-9438-a9bd0ba002d4 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:47.938960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6675b9-9802-440e-9438-a9bd0ba002d4 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:47.998704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:47.999359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:47.999640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:47.999915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] PATH_INFO: `/v3/users/08d7f4b3ed014eeea3e611c29b6b6320` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:48.001032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d7f4b3ed014eeea3e611c29b6b6320)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:48.003032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:48.160472 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:48.169051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d7f4b3ed014eeea3e611c29b6b6320'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.169703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d7f4b3ed014eeea3e611c29b6b6320'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.176694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d7f4b3ed014eeea3e611c29b6b6320'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.241259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d7f4b3ed014eeea3e611c29b6b6320'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.241926 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5140e278-0ca1-4d16-ad3d-29eeb176a084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d7f4b3ed014eeea3e611c29b6b6320'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.260219 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1336/2635] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:47 2022] DELETE /identity/v3/users/08d7f4b3ed014eeea3e611c29b6b6320 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:48.637750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:48.639319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:48.653725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e0f90-3711-4b4e-b5fc-ddec91f75952 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:48.718851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:48.719511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:48.719923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:48.720206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] PATH_INFO: `/v3/projects/b91fa1b2aba844b08617b109084e9b26` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:48.721437 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91fa1b2aba844b08617b109084e9b26)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:48.723510 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:48.735903 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:48.841475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91fa1b2aba844b08617b109084e9b26', 'request_id': 'req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.847930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91fa1b2aba844b08617b109084e9b26', 'request_id': 'req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.853682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91fa1b2aba844b08617b109084e9b26', 'request_id': 'req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.925568 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] The token cache is being invalidate because project b91fa1b2aba844b08617b109084e9b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:48.925794 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.926485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-240bf1fe-bfd3-4648-b3fb-6fbcbbcad34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:48.928028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1300/2636] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:48 2022] DELETE /identity/v3/projects/b91fa1b2aba844b08617b109084e9b26 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:48.932967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9094482-9617-401e-8b01-4bc5a6ad699b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:48.933436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9094482-9617-401e-8b01-4bc5a6ad699b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:48.933521 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9094482-9617-401e-8b01-4bc5a6ad699b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:48.953307 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b9094482-9617-401e-8b01-4bc5a6ad699b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:48.954537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9094482-9617-401e-8b01-4bc5a6ad699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:49.012474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1337/2637] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:49.020239 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934029d-2200-47e3-b204-a0f06af5785d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.020530 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934029d-2200-47e3-b204-a0f06af5785d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.020805 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934029d-2200-47e3-b204-a0f06af5785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.041319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7934029d-2200-47e3-b204-a0f06af5785d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:49.042565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7934029d-2200-47e3-b204-a0f06af5785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:49.050555 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1301/2638] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:49.054910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9094482-9617-401e-8b01-4bc5a6ad699b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:49.064378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9094482-9617-401e-8b01-4bc5a6ad699b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:49.068872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01309711-794a-4f5c-a9c8-8f3e0a137c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:49.069462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01309711-794a-4f5c-a9c8-8f3e0a137c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.069739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01309711-794a-4f5c-a9c8-8f3e0a137c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.070009 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01309711-794a-4f5c-a9c8-8f3e0a137c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.070679 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01309711-794a-4f5c-a9c8-8f3e0a137c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:06:49.070978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01309711-794a-4f5c-a9c8-8f3e0a137c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:49.072593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01309711-794a-4f5c-a9c8-8f3e0a137c36 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:49.083675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1338/2639] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:06:49.088113 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934029d-2200-47e3-b204-a0f06af5785d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:49.096980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934029d-2200-47e3-b204-a0f06af5785d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:49.102339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35df373-7cdb-4fcb-aa08-ce69965110d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:49.102925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35df373-7cdb-4fcb-aa08-ce69965110d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.103205 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35df373-7cdb-4fcb-aa08-ce69965110d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.103476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35df373-7cdb-4fcb-aa08-ce69965110d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.104110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35df373-7cdb-4fcb-aa08-ce69965110d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:49.105971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35df373-7cdb-4fcb-aa08-ce69965110d5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:49.197670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1302/2640] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:49 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:49.201864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01309711-794a-4f5c-a9c8-8f3e0a137c36 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:49.212789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01309711-794a-4f5c-a9c8-8f3e0a137c36 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:49.269092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8e1a0-d02b-44ff-84b3-51d076db86fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:49.269743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8e1a0-d02b-44ff-84b3-51d076db86fb admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.270010 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8e1a0-d02b-44ff-84b3-51d076db86fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.270314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8e1a0-d02b-44ff-84b3-51d076db86fb admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.270987 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8e1a0-d02b-44ff-84b3-51d076db86fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:49.272919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8e1a0-d02b-44ff-84b3-51d076db86fb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:49.344751 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1339/2641] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:49 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:49.348792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35df373-7cdb-4fcb-aa08-ce69965110d5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:49.359356 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35df373-7cdb-4fcb-aa08-ce69965110d5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:49.363998 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5490d4-b561-4b96-acc0-8a2f4ba22d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:49.364584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5490d4-b561-4b96-acc0-8a2f4ba22d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.364864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5490d4-b561-4b96-acc0-8a2f4ba22d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.365153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5490d4-b561-4b96-acc0-8a2f4ba22d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.366376 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5490d4-b561-4b96-acc0-8a2f4ba22d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:49.367985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5490d4-b561-4b96-acc0-8a2f4ba22d17 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:49.377607 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1303/2642] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:49.381308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8e1a0-d02b-44ff-84b3-51d076db86fb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:49.391341 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8e1a0-d02b-44ff-84b3-51d076db86fb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:49.395970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bd998-5781-4f68-99ec-990cb890183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:49.396557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bd998-5781-4f68-99ec-990cb890183e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.396844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bd998-5781-4f68-99ec-990cb890183e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.397121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bd998-5781-4f68-99ec-990cb890183e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.397764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bd998-5781-4f68-99ec-990cb890183e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:49.399402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bd998-5781-4f68-99ec-990cb890183e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:49.410073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1340/2643] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:49.414625 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5490d4-b561-4b96-acc0-8a2f4ba22d17 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:49.424582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5490d4-b561-4b96-acc0-8a2f4ba22d17 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:49.429680 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd47b0-013d-4ba8-8ed4-cfc846da00aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:49.430365 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd47b0-013d-4ba8-8ed4-cfc846da00aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.430649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd47b0-013d-4ba8-8ed4-cfc846da00aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.430925 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd47b0-013d-4ba8-8ed4-cfc846da00aa admin admin] PATH_INFO: `/v3/projects/cc92784aa1a54b49bc87051ccc3e2568/users/4da5475f4a0640b5b4ef2ce8df417260/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.444789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd47b0-013d-4ba8-8ed4-cfc846da00aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc92784aa1a54b49bc87051ccc3e2568, user_id=4da5475f4a0640b5b4ef2ce8df417260, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:49.447470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd47b0-013d-4ba8-8ed4-cfc846da00aa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:49.533028 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1304/2644] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:49 2022] PUT /identity/v3/projects/cc92784aa1a54b49bc87051ccc3e2568/users/4da5475f4a0640b5b4ef2ce8df417260/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:49.597252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08af0-6e65-4a58-a1f1-c4b905fb3c82 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.597544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08af0-6e65-4a58-a1f1-c4b905fb3c82 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.597853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08af0-6e65-4a58-a1f1-c4b905fb3c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.626272 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-58a08af0-6e65-4a58-a1f1-c4b905fb3c82 None None] MFA Rules not processed for user `4da5475f4a0640b5b4ef2ce8df417260`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:49.627503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-58a08af0-6e65-4a58-a1f1-c4b905fb3c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:49.635388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:49.690646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1341/2645] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:49.695114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd47b0-013d-4ba8-8ed4-cfc846da00aa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:49.754688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd47b0-013d-4ba8-8ed4-cfc846da00aa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:49.759224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d7af3-7480-422f-96d2-2bf590dffa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:49.759832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d7af3-7480-422f-96d2-2bf590dffa45 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.760090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d7af3-7480-422f-96d2-2bf590dffa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.760360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d7af3-7480-422f-96d2-2bf590dffa45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.760989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d7af3-7480-422f-96d2-2bf590dffa45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:49.762887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d7af3-7480-422f-96d2-2bf590dffa45 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:49.889696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1305/2646] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:49 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:49.893808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08af0-6e65-4a58-a1f1-c4b905fb3c82 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:49.905134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08af0-6e65-4a58-a1f1-c4b905fb3c82 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:49.968725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd6084-0a72-4dc3-bea9-9e23a741fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:49.969401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd6084-0a72-4dc3-bea9-9e23a741fdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:49.969612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd6084-0a72-4dc3-bea9-9e23a741fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:49.971063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd6084-0a72-4dc3-bea9-9e23a741fdc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:49.971063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd6084-0a72-4dc3-bea9-9e23a741fdc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:49.972506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd6084-0a72-4dc3-bea9-9e23a741fdc7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:50.053680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1342/2647] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:49 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:06:50.057718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d7af3-7480-422f-96d2-2bf590dffa45 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:50.068013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d7af3-7480-422f-96d2-2bf590dffa45 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:50.073232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b07a1-331f-4875-8e31-31eb5b0e8ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:50.073827 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b07a1-331f-4875-8e31-31eb5b0e8ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:50.074202 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b07a1-331f-4875-8e31-31eb5b0e8ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:50.074483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b07a1-331f-4875-8e31-31eb5b0e8ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:50.075123 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b07a1-331f-4875-8e31-31eb5b0e8ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:50.076707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b07a1-331f-4875-8e31-31eb5b0e8ea9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:50.088507 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1306/2648] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:50.092165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd6084-0a72-4dc3-bea9-9e23a741fdc7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:50.102355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd6084-0a72-4dc3-bea9-9e23a741fdc7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:50.106981 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d94e6-0d88-4174-a666-86cd550b301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:50.107628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d94e6-0d88-4174-a666-86cd550b301e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:50.107910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d94e6-0d88-4174-a666-86cd550b301e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:50.108187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d94e6-0d88-4174-a666-86cd550b301e admin admin] PATH_INFO: `/v3/projects/49453af13fb64fce86b98986dfda23fa/users/d8046e1a6b0d4bd88f693552fbacb3d9/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:50.122484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d94e6-0d88-4174-a666-86cd550b301e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49453af13fb64fce86b98986dfda23fa, user_id=d8046e1a6b0d4bd88f693552fbacb3d9, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:50.125409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d94e6-0d88-4174-a666-86cd550b301e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:50.225269 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1343/2649] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:50 2022] PUT /identity/v3/projects/49453af13fb64fce86b98986dfda23fa/users/d8046e1a6b0d4bd88f693552fbacb3d9/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:50.229595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b07a1-331f-4875-8e31-31eb5b0e8ea9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:50.239475 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b07a1-331f-4875-8e31-31eb5b0e8ea9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:50.247720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:50.294596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954afa04-bbc7-4055-8e77-bd9a9f6a2fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:50.295198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954afa04-bbc7-4055-8e77-bd9a9f6a2fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:50.295477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954afa04-bbc7-4055-8e77-bd9a9f6a2fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:50.295752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954afa04-bbc7-4055-8e77-bd9a9f6a2fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:50.296389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954afa04-bbc7-4055-8e77-bd9a9f6a2fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:50.297995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954afa04-bbc7-4055-8e77-bd9a9f6a2fbf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:50.308044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1307/2650] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:50.312467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d94e6-0d88-4174-a666-86cd550b301e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:50.322780 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d94e6-0d88-4174-a666-86cd550b301e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:50.327375 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134042c4-b04a-4c1f-8101-433962b75f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:50.328011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134042c4-b04a-4c1f-8101-433962b75f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:50.328288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134042c4-b04a-4c1f-8101-433962b75f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:50.328559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134042c4-b04a-4c1f-8101-433962b75f76 admin admin] PATH_INFO: `/v3/projects/49453af13fb64fce86b98986dfda23fa/users/d8046e1a6b0d4bd88f693552fbacb3d9/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:50.330467 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134042c4-b04a-4c1f-8101-433962b75f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49453af13fb64fce86b98986dfda23fa, user_id=d8046e1a6b0d4bd88f693552fbacb3d9, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:50.333044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134042c4-b04a-4c1f-8101-433962b75f76 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:50.342936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1344/2651] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:50 2022] PUT /identity/v3/projects/49453af13fb64fce86b98986dfda23fa/users/d8046e1a6b0d4bd88f693552fbacb3d9/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:50.353387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efefe3-da98-4e5a-95e8-87d4dbb6adc9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:50.353669 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efefe3-da98-4e5a-95e8-87d4dbb6adc9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:50.353940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efefe3-da98-4e5a-95e8-87d4dbb6adc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:50.382226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-43efefe3-da98-4e5a-95e8-87d4dbb6adc9 None None] MFA Rules not processed for user `d8046e1a6b0d4bd88f693552fbacb3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:50.383516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-43efefe3-da98-4e5a-95e8-87d4dbb6adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:50.452432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1308/2652] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:50.464251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134042c4-b04a-4c1f-8101-433962b75f76 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:50.465943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-134042c4-b04a-4c1f-8101-433962b75f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:50.522808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134042c4-b04a-4c1f-8101-433962b75f76 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:50.526449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da644ab-e69b-4130-94b4-890f549f4c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:50.527103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da644ab-e69b-4130-94b4-890f549f4c4c service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:50.527381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da644ab-e69b-4130-94b4-890f549f4c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:50.527672 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da644ab-e69b-4130-94b4-890f549f4c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:50.536684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da644ab-e69b-4130-94b4-890f549f4c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:50.538263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da644ab-e69b-4130-94b4-890f549f4c4c service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:50.547879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1345/2653] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:50.685334 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efefe3-da98-4e5a-95e8-87d4dbb6adc9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:50.696570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efefe3-da98-4e5a-95e8-87d4dbb6adc9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:50.700104 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2b987-e23e-4c56-b017-e5a01efd9fe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:50.700694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b987-e23e-4c56-b017-e5a01efd9fe0 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:50.700971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b987-e23e-4c56-b017-e5a01efd9fe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:50.701242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b987-e23e-4c56-b017-e5a01efd9fe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:50.755509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2b987-e23e-4c56-b017-e5a01efd9fe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:50.757582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2b987-e23e-4c56-b017-e5a01efd9fe0 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:50.766277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1309/2654] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:51.255143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da644ab-e69b-4130-94b4-890f549f4c4c service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:51.260473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:51.316856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da644ab-e69b-4130-94b4-890f549f4c4c service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:51.321513 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:51.322162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:51.322480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:51.322752 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] PATH_INFO: `/v3/users/4da5475f4a0640b5b4ef2ce8df417260` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:51.323867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da5475f4a0640b5b4ef2ce8df417260)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:51.325769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:51.528275 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da5475f4a0640b5b4ef2ce8df417260'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:51.528838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da5475f4a0640b5b4ef2ce8df417260'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:51.535735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da5475f4a0640b5b4ef2ce8df417260'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:51.602147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da5475f4a0640b5b4ef2ce8df417260'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:51.602982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da5475f4a0640b5b4ef2ce8df417260'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:51.623512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1346/2655] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:51 2022] DELETE /identity/v3/users/4da5475f4a0640b5b4ef2ce8df417260 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:51.628026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286163c-f9b8-4649-a734-d21c01885938 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:51.628318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286163c-f9b8-4649-a734-d21c01885938 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:51.628600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286163c-f9b8-4649-a734-d21c01885938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:51.647107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9286163c-f9b8-4649-a734-d21c01885938 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:51.648299 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9286163c-f9b8-4649-a734-d21c01885938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:51.673247 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:51.705173 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1310/2656] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:51.714816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:51.716248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:51.772765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9344a10-8e41-48f8-bede-308e8103c680 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:51.776578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed706a-e1ac-4c8a-a5ad-33d4322a50a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:51.777187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed706a-e1ac-4c8a-a5ad-33d4322a50a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:51.777469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed706a-e1ac-4c8a-a5ad-33d4322a50a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:51.777745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed706a-e1ac-4c8a-a5ad-33d4322a50a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:51.786764 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed706a-e1ac-4c8a-a5ad-33d4322a50a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:51.788647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed706a-e1ac-4c8a-a5ad-33d4322a50a1 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:51.798427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1347/2657] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:52.215813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286163c-f9b8-4649-a734-d21c01885938 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:52.215813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9286163c-f9b8-4649-a734-d21c01885938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:52.225317 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286163c-f9b8-4649-a734-d21c01885938 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:52.230230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:52.230934 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:52.231222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:52.231525 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] PATH_INFO: `/v3/projects/cc92784aa1a54b49bc87051ccc3e2568` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:52.232689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc92784aa1a54b49bc87051ccc3e2568)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:52.235012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:52.340364 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc92784aa1a54b49bc87051ccc3e2568', 'request_id': 'req-0b087bfc-417f-48fd-b568-d12ded343c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.346732 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc92784aa1a54b49bc87051ccc3e2568', 'request_id': 'req-0b087bfc-417f-48fd-b568-d12ded343c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.357263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc92784aa1a54b49bc87051ccc3e2568', 'request_id': 'req-0b087bfc-417f-48fd-b568-d12ded343c5a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.441244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] The token cache is being invalidate because project cc92784aa1a54b49bc87051ccc3e2568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:52.441540 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.442184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.443720 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1311/2658] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:52 2022] DELETE /identity/v3/projects/cc92784aa1a54b49bc87051ccc3e2568 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:52.447738 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed706a-e1ac-4c8a-a5ad-33d4322a50a1 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:52.457644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed706a-e1ac-4c8a-a5ad-33d4322a50a1 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:52.481312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:52.513137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:52.513761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:52.514044 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:52.514350 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] PATH_INFO: `/v3/users/d8046e1a6b0d4bd88f693552fbacb3d9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:52.515493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8046e1a6b0d4bd88f693552fbacb3d9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:52.517816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:52.708022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8046e1a6b0d4bd88f693552fbacb3d9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.708598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8046e1a6b0d4bd88f693552fbacb3d9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.716367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8046e1a6b0d4bd88f693552fbacb3d9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.778827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8046e1a6b0d4bd88f693552fbacb3d9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.779564 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-da9f3572-0857-4fee-9d80-22893e64ab69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8046e1a6b0d4bd88f693552fbacb3d9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:52.797663 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1348/2659] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:06:52 2022] DELETE /identity/v3/users/d8046e1a6b0d4bd88f693552fbacb3d9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:06:53.186733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:53.188271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:53.202348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b087bfc-417f-48fd-b568-d12ded343c5a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:53.258914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:53.259546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:53.259832 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:53.260107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] PATH_INFO: `/v3/projects/49453af13fb64fce86b98986dfda23fa` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:53.261222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=49453af13fb64fce86b98986dfda23fa)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:53.263150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:53.350013 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49453af13fb64fce86b98986dfda23fa', 'request_id': 'req-53fd168f-8d74-47b1-a979-0451381168fe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:53.355999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49453af13fb64fce86b98986dfda23fa', 'request_id': 'req-53fd168f-8d74-47b1-a979-0451381168fe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:53.357890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:53.361776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49453af13fb64fce86b98986dfda23fa', 'request_id': 'req-53fd168f-8d74-47b1-a979-0451381168fe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:53.446725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] The token cache is being invalidate because project 49453af13fb64fce86b98986dfda23fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:06:53.447012 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:53.447637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-53fd168f-8d74-47b1-a979-0451381168fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:06:53.449132 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1312/2660] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:06:53 2022] DELETE /identity/v3/projects/49453af13fb64fce86b98986dfda23fa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:06:53.454028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f8b6c-282c-4cc2-8b98-7d92de543123 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:53.454537 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f8b6c-282c-4cc2-8b98-7d92de543123 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:53.455787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f8b6c-282c-4cc2-8b98-7d92de543123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:53.475212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5c6f8b6c-282c-4cc2-8b98-7d92de543123 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:53.476416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5c6f8b6c-282c-4cc2-8b98-7d92de543123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:53.536879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1349/2661] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:06:53.544583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a1aaa-d438-46ff-8d86-906ee77f39e1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:53.544870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a1aaa-d438-46ff-8d86-906ee77f39e1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:53.545143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a1aaa-d438-46ff-8d86-906ee77f39e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:53.564890 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fa9a1aaa-d438-46ff-8d86-906ee77f39e1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:53.566071 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fa9a1aaa-d438-46ff-8d86-906ee77f39e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:53.574429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1313/2662] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:53.578367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f8b6c-282c-4cc2-8b98-7d92de543123 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:53.587967 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f8b6c-282c-4cc2-8b98-7d92de543123 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:53.592517 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549d0b-fb66-4a1e-a6ac-3356a2e0298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:53.593108 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549d0b-fb66-4a1e-a6ac-3356a2e0298c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:53.593388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549d0b-fb66-4a1e-a6ac-3356a2e0298c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:53.593661 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549d0b-fb66-4a1e-a6ac-3356a2e0298c admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:53.594335 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549d0b-fb66-4a1e-a6ac-3356a2e0298c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:06:53.594646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549d0b-fb66-4a1e-a6ac-3356a2e0298c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:53.596241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549d0b-fb66-4a1e-a6ac-3356a2e0298c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:53.607508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1350/2663] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:06:53.611604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a1aaa-d438-46ff-8d86-906ee77f39e1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:53.621060 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a1aaa-d438-46ff-8d86-906ee77f39e1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:53.625567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c305-fa28-48a5-8123-946e9233041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:53.626262 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c305-fa28-48a5-8123-946e9233041f admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:53.626546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c305-fa28-48a5-8123-946e9233041f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:53.626818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c305-fa28-48a5-8123-946e9233041f admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:53.627450 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c305-fa28-48a5-8123-946e9233041f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:53.629318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c305-fa28-48a5-8123-946e9233041f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:53.715987 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1314/2664] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:06:53 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:06:53.720235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549d0b-fb66-4a1e-a6ac-3356a2e0298c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:53.730404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549d0b-fb66-4a1e-a6ac-3356a2e0298c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:53.761593 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:06:53.787860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8629e-049a-4ed4-ae85-412f6a2e51f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:53.788611 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8629e-049a-4ed4-ae85-412f6a2e51f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:53.788891 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8629e-049a-4ed4-ae85-412f6a2e51f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:53.789164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8629e-049a-4ed4-ae85-412f6a2e51f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:53.789796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8629e-049a-4ed4-ae85-412f6a2e51f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:53.791781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8629e-049a-4ed4-ae85-412f6a2e51f5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:53.934041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1351/2665] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:06:53 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:06:53.937913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c305-fa28-48a5-8123-946e9233041f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:53.948395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c305-fa28-48a5-8123-946e9233041f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:53.952867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf5df9-f890-4e41-9c29-90234d81c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:53.958603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf5df9-f890-4e41-9c29-90234d81c2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:53.958603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf5df9-f890-4e41-9c29-90234d81c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:53.958603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf5df9-f890-4e41-9c29-90234d81c2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:53.958603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf5df9-f890-4e41-9c29-90234d81c2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:53.958603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf5df9-f890-4e41-9c29-90234d81c2c7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:53.966324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1315/2666] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:53.970346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8629e-049a-4ed4-ae85-412f6a2e51f5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:53.980779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8629e-049a-4ed4-ae85-412f6a2e51f5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:53.985342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b00f3-d585-47cf-ba8e-de499f9e1a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:53.985942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b00f3-d585-47cf-ba8e-de499f9e1a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:53.986288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b00f3-d585-47cf-ba8e-de499f9e1a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:53.986567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b00f3-d585-47cf-ba8e-de499f9e1a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:53.987213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b00f3-d585-47cf-ba8e-de499f9e1a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:53.988811 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b00f3-d585-47cf-ba8e-de499f9e1a51 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:53.998900 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1352/2667] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:06:54.003120 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf5df9-f890-4e41-9c29-90234d81c2c7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:54.013402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf5df9-f890-4e41-9c29-90234d81c2c7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:54.017880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48081c-20e2-4333-8457-0e70abe67043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:54.018551 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48081c-20e2-4333-8457-0e70abe67043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:54.018835 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48081c-20e2-4333-8457-0e70abe67043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:54.019112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48081c-20e2-4333-8457-0e70abe67043 admin admin] PATH_INFO: `/v3/projects/dbc177b54c294a8288557b4866a15bce/users/4d649688787543ed99afac6c9d8eb6d5/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:54.033679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48081c-20e2-4333-8457-0e70abe67043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc177b54c294a8288557b4866a15bce, user_id=4d649688787543ed99afac6c9d8eb6d5, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:54.036333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48081c-20e2-4333-8457-0e70abe67043 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:54.133406 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1316/2668] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:06:54 2022] PUT /identity/v3/projects/dbc177b54c294a8288557b4866a15bce/users/4d649688787543ed99afac6c9d8eb6d5/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:06:54.144687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9b36-679c-40d3-8a25-cf687b56c281 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:54.147648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9b36-679c-40d3-8a25-cf687b56c281 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:54.147648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9b36-679c-40d3-8a25-cf687b56c281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:54.173214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5cea9b36-679c-40d3-8a25-cf687b56c281 None None] MFA Rules not processed for user `4d649688787543ed99afac6c9d8eb6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:06:54.174442 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5cea9b36-679c-40d3-8a25-cf687b56c281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:54.241711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1353/2669] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:06:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:06:54.252096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48081c-20e2-4333-8457-0e70abe67043 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:06:54.253850 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ec48081c-20e2-4333-8457-0e70abe67043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:06:54.309227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48081c-20e2-4333-8457-0e70abe67043 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:06:54.312797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f9a76-32c9-49d8-b7b1-d8c7def6cdba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:06:54.313382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f9a76-32c9-49d8-b7b1-d8c7def6cdba service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:06:54.313664 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f9a76-32c9-49d8-b7b1-d8c7def6cdba service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:06:54.313930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f9a76-32c9-49d8-b7b1-d8c7def6cdba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:06:54.322588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f9a76-32c9-49d8-b7b1-d8c7def6cdba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:06:54.324029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f9a76-32c9-49d8-b7b1-d8c7def6cdba service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:06:54.332473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1317/2670] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:06:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:03.061831 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9add4b-6128-460a-b95e-934dbc0e53dd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:03.062336 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9add4b-6128-460a-b95e-934dbc0e53dd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:03.062434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9add4b-6128-460a-b95e-934dbc0e53dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:03.081737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ee9add4b-6128-460a-b95e-934dbc0e53dd None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:03.082960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ee9add4b-6128-460a-b95e-934dbc0e53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:03.139066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1354/2671] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:07:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:07:03.256868 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f9a76-32c9-49d8-b7b1-d8c7def6cdba service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:03.258554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-699f9a76-32c9-49d8-b7b1-d8c7def6cdba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:03.326881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f9a76-32c9-49d8-b7b1-d8c7def6cdba service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:03.332025 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffba9f-c49b-4114-ad2e-be246ab00b8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:03.332630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffba9f-c49b-4114-ad2e-be246ab00b8b service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:03.332911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffba9f-c49b-4114-ad2e-be246ab00b8b service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:03.333185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffba9f-c49b-4114-ad2e-be246ab00b8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:03.341284 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffba9f-c49b-4114-ad2e-be246ab00b8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:03.342971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ffba9f-c49b-4114-ad2e-be246ab00b8b service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:03.350826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1318/2672] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:07:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:07:05.537732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9add4b-6128-460a-b95e-934dbc0e53dd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:05.593052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:05.612040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9add4b-6128-460a-b95e-934dbc0e53dd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:05.616660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:05.619840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:05.619840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:05.619840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] PATH_INFO: `/v3/users/4d649688787543ed99afac6c9d8eb6d5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:05.619840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d649688787543ed99afac6c9d8eb6d5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:05.623110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:05.824588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d649688787543ed99afac6c9d8eb6d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:05.825580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d649688787543ed99afac6c9d8eb6d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:05.836055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d649688787543ed99afac6c9d8eb6d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:05.899609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d649688787543ed99afac6c9d8eb6d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:05.900333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d649688787543ed99afac6c9d8eb6d5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:05.931875 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1355/2673] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:07:05 2022] DELETE /identity/v3/users/4d649688787543ed99afac6c9d8eb6d5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:05.933757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9d6d8-5a5a-4b52-ad2c-e0b168ce23fd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:05.934322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9d6d8-5a5a-4b52-ad2c-e0b168ce23fd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:05.934504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9d6d8-5a5a-4b52-ad2c-e0b168ce23fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:05.960809 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-27c9d6d8-5a5a-4b52-ad2c-e0b168ce23fd None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:05.962114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-27c9d6d8-5a5a-4b52-ad2c-e0b168ce23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:05.979227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:06.058204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1319/2674] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:06.067067 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:06.069757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:06.129736 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243397de-0381-4c45-8332-6e34c7536948 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:06.133936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd802ea7-d09f-41a1-88e3-b8d1fcaf5c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:06.134584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd802ea7-d09f-41a1-88e3-b8d1fcaf5c19 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:06.134872 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd802ea7-d09f-41a1-88e3-b8d1fcaf5c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:06.135145 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd802ea7-d09f-41a1-88e3-b8d1fcaf5c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:06.145544 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd802ea7-d09f-41a1-88e3-b8d1fcaf5c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:06.147576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd802ea7-d09f-41a1-88e3-b8d1fcaf5c19 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:06.158288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1356/2675] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:06.604478 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9d6d8-5a5a-4b52-ad2c-e0b168ce23fd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:06.606411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-27c9d6d8-5a5a-4b52-ad2c-e0b168ce23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:06.628721 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9d6d8-5a5a-4b52-ad2c-e0b168ce23fd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:06.637442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:06.641187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:06.641187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:06.641187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] PATH_INFO: `/v3/projects/dbc177b54c294a8288557b4866a15bce` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:06.642609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc177b54c294a8288557b4866a15bce)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:06.643879 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:06.770503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc177b54c294a8288557b4866a15bce', 'request_id': 'req-35997926-0783-45c4-9463-fb86ca5277cd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:06.778854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc177b54c294a8288557b4866a15bce', 'request_id': 'req-35997926-0783-45c4-9463-fb86ca5277cd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:06.785981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc177b54c294a8288557b4866a15bce', 'request_id': 'req-35997926-0783-45c4-9463-fb86ca5277cd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:06.873360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] The token cache is being invalidate because project dbc177b54c294a8288557b4866a15bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:07:06.873754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:06.874882 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:06.884870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1320/2676] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:07:06 2022] DELETE /identity/v3/projects/dbc177b54c294a8288557b4866a15bce => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:06.887359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f6294-77c2-4a6b-8fc8-a3fdc375fdc1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:06.887856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f6294-77c2-4a6b-8fc8-a3fdc375fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:06.888087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f6294-77c2-4a6b-8fc8-a3fdc375fdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:06.892826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:06.895192 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:06.921632 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e36f6294-77c2-4a6b-8fc8-a3fdc375fdc1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:06.924162 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e36f6294-77c2-4a6b-8fc8-a3fdc375fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:07.049016 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35997926-0783-45c4-9463-fb86ca5277cd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:07.050722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1357/2677] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:07.059035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ea08-f1c9-4f80-a8d7-b156279728ca None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.059035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ea08-f1c9-4f80-a8d7-b156279728ca None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.059035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ea08-f1c9-4f80-a8d7-b156279728ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.064986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a387c-0916-44a8-a05e-dfd7d61d020b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:07.065630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a387c-0916-44a8-a05e-dfd7d61d020b service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.066335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a387c-0916-44a8-a05e-dfd7d61d020b service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.066335 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a387c-0916-44a8-a05e-dfd7d61d020b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.068393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b41a387c-0916-44a8-a05e-dfd7d61d020b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:07.083950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a387c-0916-44a8-a05e-dfd7d61d020b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:07.085685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a387c-0916-44a8-a05e-dfd7d61d020b service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:07.085814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6e05ea08-f1c9-4f80-a8d7-b156279728ca None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:07.087261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e05ea08-f1c9-4f80-a8d7-b156279728ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:07.100238 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1358/2678] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:07.104120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05ea08-f1c9-4f80-a8d7-b156279728ca None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:07.107793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1321/2679] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:07.110995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:07.117311 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05ea08-f1c9-4f80-a8d7-b156279728ca None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:07.122718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6559ce-05e1-458a-aa33-35bcf13b6f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:07.123326 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6559ce-05e1-458a-aa33-35bcf13b6f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.125470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6559ce-05e1-458a-aa33-35bcf13b6f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.125470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6559ce-05e1-458a-aa33-35bcf13b6f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.125470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6559ce-05e1-458a-aa33-35bcf13b6f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:07:07.125470 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6559ce-05e1-458a-aa33-35bcf13b6f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:07.127382 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6559ce-05e1-458a-aa33-35bcf13b6f59 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:07.143892 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1359/2680] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:07:07.145469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a387c-0916-44a8-a05e-dfd7d61d020b service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:07.158979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a387c-0916-44a8-a05e-dfd7d61d020b service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:07.165243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69fbfb-b6a1-4547-8fb4-59aab46cb418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:07.165855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69fbfb-b6a1-4547-8fb4-59aab46cb418 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.166163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69fbfb-b6a1-4547-8fb4-59aab46cb418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.166436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69fbfb-b6a1-4547-8fb4-59aab46cb418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.167331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69fbfb-b6a1-4547-8fb4-59aab46cb418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:07.169224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69fbfb-b6a1-4547-8fb4-59aab46cb418 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:07.282425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:07.290368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1322/2681] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:07:07 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:07.294515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6559ce-05e1-458a-aa33-35bcf13b6f59 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:07.308280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6559ce-05e1-458a-aa33-35bcf13b6f59 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:07.374778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9632f8-418d-406e-9012-5a7a9f3051de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:07.375316 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9632f8-418d-406e-9012-5a7a9f3051de admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.375597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9632f8-418d-406e-9012-5a7a9f3051de admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.375869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9632f8-418d-406e-9012-5a7a9f3051de admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.378113 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9632f8-418d-406e-9012-5a7a9f3051de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:07.379049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9632f8-418d-406e-9012-5a7a9f3051de admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:07.493056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1360/2682] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:07:07 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:07.497362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69fbfb-b6a1-4547-8fb4-59aab46cb418 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:07.509821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69fbfb-b6a1-4547-8fb4-59aab46cb418 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:07.515230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95c53-2800-4f6b-a563-3f5f2bbca114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:07.518271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95c53-2800-4f6b-a563-3f5f2bbca114 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.518271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95c53-2800-4f6b-a563-3f5f2bbca114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.518271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95c53-2800-4f6b-a563-3f5f2bbca114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.518271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f95c53-2800-4f6b-a563-3f5f2bbca114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:07.519979 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f95c53-2800-4f6b-a563-3f5f2bbca114 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:07.534302 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1323/2683] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:07:07.535539 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9632f8-418d-406e-9012-5a7a9f3051de admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:07.546815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9632f8-418d-406e-9012-5a7a9f3051de admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:07.551924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b189ec3-f0c6-4778-8771-96713acb55d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:07.552704 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b189ec3-f0c6-4778-8771-96713acb55d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.553198 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b189ec3-f0c6-4778-8771-96713acb55d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.553469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b189ec3-f0c6-4778-8771-96713acb55d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.554310 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b189ec3-f0c6-4778-8771-96713acb55d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:07.555979 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b189ec3-f0c6-4778-8771-96713acb55d9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:07.569606 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1361/2684] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:07:07.573758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95c53-2800-4f6b-a563-3f5f2bbca114 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:07.586250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95c53-2800-4f6b-a563-3f5f2bbca114 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:07.591039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabc143-e446-4f13-85c0-ded0284d4dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:07.591772 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc143-e446-4f13-85c0-ded0284d4dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.592035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc143-e446-4f13-85c0-ded0284d4dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.592346 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc143-e446-4f13-85c0-ded0284d4dc8 admin admin] PATH_INFO: `/v3/projects/f5afab629a1e4143a4d58209296fa908/users/8cdfe162e5c2471ba9fd239ab82789a9/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.608768 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabc143-e446-4f13-85c0-ded0284d4dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5afab629a1e4143a4d58209296fa908, user_id=8cdfe162e5c2471ba9fd239ab82789a9, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:07.611554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabc143-e446-4f13-85c0-ded0284d4dc8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:07.687342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1324/2685] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:07 2022] PUT /identity/v3/projects/f5afab629a1e4143a4d58209296fa908/users/8cdfe162e5c2471ba9fd239ab82789a9/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:07:07.692487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cd63f-52c3-4044-bde8-7bac26151348 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.693488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cd63f-52c3-4044-bde8-7bac26151348 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.694320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cd63f-52c3-4044-bde8-7bac26151348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.719333 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cb3cd63f-52c3-4044-bde8-7bac26151348 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:07.720656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cb3cd63f-52c3-4044-bde8-7bac26151348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:07.788978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1362/2686] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:07:07.799641 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabc143-e446-4f13-85c0-ded0284d4dc8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:07.801539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-aaabc143-e446-4f13-85c0-ded0284d4dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:07.874362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabc143-e446-4f13-85c0-ded0284d4dc8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:07.881025 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5bc33-a838-4f0c-9e8d-0d52124eb809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:07.882008 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5bc33-a838-4f0c-9e8d-0d52124eb809 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:07.882550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5bc33-a838-4f0c-9e8d-0d52124eb809 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:07.883033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5bc33-a838-4f0c-9e8d-0d52124eb809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:07.893829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5bc33-a838-4f0c-9e8d-0d52124eb809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:07.897020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5bc33-a838-4f0c-9e8d-0d52124eb809 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:07.907980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1325/2687] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:16.170258 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cd63f-52c3-4044-bde8-7bac26151348 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:16.282807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aec0a-6daa-48e8-a638-58a4334c0a39 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:16.283385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aec0a-6daa-48e8-a638-58a4334c0a39 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:16.283486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aec0a-6daa-48e8-a638-58a4334c0a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:16.293022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cd63f-52c3-4044-bde8-7bac26151348 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:16.306773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:16.310688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:16.310982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:16.311286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:16.314718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:16.333848 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:16.340770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-957aec0a-6daa-48e8-a638-58a4334c0a39 None None] MFA Rules not processed for user `8cdfe162e5c2471ba9fd239ab82789a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:16.342411 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:16.343079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-957aec0a-6daa-48e8-a638-58a4334c0a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:16.345249 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:16.359871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1363/2688] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:16.454707 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:16.457432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:16.481135 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1326/2689] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:07:16.486860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e297d7a-35e1-4d36-8c2a-25eaeee285c1 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:16.488606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aec0a-6daa-48e8-a638-58a4334c0a39 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:16.501028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7cf9c-5ded-41d6-8c63-7f676f9f2f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:16.501588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7cf9c-5ded-41d6-8c63-7f676f9f2f66 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:16.501871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7cf9c-5ded-41d6-8c63-7f676f9f2f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:16.502252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7cf9c-5ded-41d6-8c63-7f676f9f2f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:16.505573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0ce7cf9c-5ded-41d6-8c63-7f676f9f2f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:16.509504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aec0a-6daa-48e8-a638-58a4334c0a39 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:16.515242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae93fbd-dfd7-4ca6-8d5b-a03f104dac68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:16.528107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae93fbd-dfd7-4ca6-8d5b-a03f104dac68 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:16.528107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae93fbd-dfd7-4ca6-8d5b-a03f104dac68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:16.528107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae93fbd-dfd7-4ca6-8d5b-a03f104dac68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:16.528107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae93fbd-dfd7-4ca6-8d5b-a03f104dac68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:16.528107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae93fbd-dfd7-4ca6-8d5b-a03f104dac68 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:16.528721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7cf9c-5ded-41d6-8c63-7f676f9f2f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:16.528721 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7cf9c-5ded-41d6-8c63-7f676f9f2f66 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:16.543853 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1364/2690] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:16.606788 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1327/2691] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:07:16 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:16.611257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7cf9c-5ded-41d6-8c63-7f676f9f2f66 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:16.627379 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7cf9c-5ded-41d6-8c63-7f676f9f2f66 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:16.704548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e17aa1-111b-4125-b72a-306e1f3f86c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:16.705356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e17aa1-111b-4125-b72a-306e1f3f86c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:16.705735 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e17aa1-111b-4125-b72a-306e1f3f86c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:16.706347 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e17aa1-111b-4125-b72a-306e1f3f86c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:16.708816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e17aa1-111b-4125-b72a-306e1f3f86c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:16.711320 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e17aa1-111b-4125-b72a-306e1f3f86c1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:16.799398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1365/2692] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:07:16 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:16.803951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae93fbd-dfd7-4ca6-8d5b-a03f104dac68 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:16.820671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae93fbd-dfd7-4ca6-8d5b-a03f104dac68 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:16.827589 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99233c19-514e-469d-8863-dbb18739b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:16.828265 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99233c19-514e-469d-8863-dbb18739b4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:16.828633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99233c19-514e-469d-8863-dbb18739b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:16.828922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99233c19-514e-469d-8863-dbb18739b4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:16.829565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99233c19-514e-469d-8863-dbb18739b4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:16.831394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99233c19-514e-469d-8863-dbb18739b4fe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:16.847260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1328/2693] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:16.848895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e17aa1-111b-4125-b72a-306e1f3f86c1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:16.860143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e17aa1-111b-4125-b72a-306e1f3f86c1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:16.866657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe212d-7fd8-46a6-b396-c1fc7147a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:16.867291 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe212d-7fd8-46a6-b396-c1fc7147a7af admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:16.867645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe212d-7fd8-46a6-b396-c1fc7147a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:16.868317 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe212d-7fd8-46a6-b396-c1fc7147a7af admin admin] PATH_INFO: `/v3/projects/e83fee72e94b446f8dc92b961f36fab7/users/1e4d4c52f73f46f489924537bf67835a/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:16.885389 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe212d-7fd8-46a6-b396-c1fc7147a7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83fee72e94b446f8dc92b961f36fab7, user_id=1e4d4c52f73f46f489924537bf67835a, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:16.888458 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe212d-7fd8-46a6-b396-c1fc7147a7af admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:16.977256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99233c19-514e-469d-8863-dbb18739b4fe admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:16.978139 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1366/2694] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:16 2022] PUT /identity/v3/projects/e83fee72e94b446f8dc92b961f36fab7/users/1e4d4c52f73f46f489924537bf67835a/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:16.987972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99233c19-514e-469d-8863-dbb18739b4fe admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:17.054751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:17.116936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8d6ae-2539-433c-9d88-a6009b2a98e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:17.122810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d6ae-2539-433c-9d88-a6009b2a98e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:17.122810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d6ae-2539-433c-9d88-a6009b2a98e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:17.122810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8d6ae-2539-433c-9d88-a6009b2a98e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:17.122810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8d6ae-2539-433c-9d88-a6009b2a98e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:17.122810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8d6ae-2539-433c-9d88-a6009b2a98e9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:17.132750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1329/2695] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:17.137642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe212d-7fd8-46a6-b396-c1fc7147a7af admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:17.151805 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe212d-7fd8-46a6-b396-c1fc7147a7af admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:17.157370 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ea787-51d1-4fad-ba25-0d4d9fd9fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:17.158418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ea787-51d1-4fad-ba25-0d4d9fd9fc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:17.158889 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ea787-51d1-4fad-ba25-0d4d9fd9fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:17.159329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ea787-51d1-4fad-ba25-0d4d9fd9fc95 admin admin] PATH_INFO: `/v3/projects/e83fee72e94b446f8dc92b961f36fab7/users/1e4d4c52f73f46f489924537bf67835a/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:17.162956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ea787-51d1-4fad-ba25-0d4d9fd9fc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83fee72e94b446f8dc92b961f36fab7, user_id=1e4d4c52f73f46f489924537bf67835a, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:17.165819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ea787-51d1-4fad-ba25-0d4d9fd9fc95 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:17.184919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1367/2696] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:17 2022] PUT /identity/v3/projects/e83fee72e94b446f8dc92b961f36fab7/users/1e4d4c52f73f46f489924537bf67835a/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:22.179865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8d6ae-2539-433c-9d88-a6009b2a98e9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:22.241199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8d6ae-2539-433c-9d88-a6009b2a98e9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:22.295777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb7302-c294-448a-a6b3-3e142b293e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:22.296494 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb7302-c294-448a-a6b3-3e142b293e2f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:22.296905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb7302-c294-448a-a6b3-3e142b293e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:22.297185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb7302-c294-448a-a6b3-3e142b293e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:22.298977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e2eb7302-c294-448a-a6b3-3e142b293e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:22.309777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb7302-c294-448a-a6b3-3e142b293e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:22.311359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb7302-c294-448a-a6b3-3e142b293e2f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:22.320756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1330/2697] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:22.769487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfd7b2-b654-48d1-8966-54efac337f87 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:22.771342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfd7b2-b654-48d1-8966-54efac337f87 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:22.771851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfd7b2-b654-48d1-8966-54efac337f87 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:22.774785 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1368/2698] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:07:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:07:22.790379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149f6e-3d10-4fbb-8dd8-860edfe082ea None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:22.790736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149f6e-3d10-4fbb-8dd8-860edfe082ea None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:22.790950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149f6e-3d10-4fbb-8dd8-860edfe082ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:22.812793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-50149f6e-3d10-4fbb-8dd8-860edfe082ea None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:22.814315 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-50149f6e-3d10-4fbb-8dd8-860edfe082ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:22.907442 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1331/2699] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:07:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:22.920346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfd7b2-b654-48d1-8966-54efac337f87 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:22.923694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-67dfd7b2-b654-48d1-8966-54efac337f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:23.003187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfd7b2-b654-48d1-8966-54efac337f87 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:23.009912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d4a08-cf0c-45e3-a5bb-39955e5227a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8339b6461e4e28bc397dcd3f85e1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:23.010570 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d4a08-cf0c-45e3-a5bb-39955e5227a8 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:23.010854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d4a08-cf0c-45e3-a5bb-39955e5227a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:23.011127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d4a08-cf0c-45e3-a5bb-39955e5227a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:23.026178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d4a08-cf0c-45e3-a5bb-39955e5227a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:23.029896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d4a08-cf0c-45e3-a5bb-39955e5227a8 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:23.044674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1369/2700] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:23.266063 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910242c-3182-45e1-aba0-8af61adc2ab3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:23.266626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910242c-3182-45e1-aba0-8af61adc2ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:23.266626 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910242c-3182-45e1-aba0-8af61adc2ab3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:23.268707 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1332/2701] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:07:23.274073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ede334-ca4c-489b-95f9-c4d7966a8614 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:23.274388 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ede334-ca4c-489b-95f9-c4d7966a8614 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:23.274667 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ede334-ca4c-489b-95f9-c4d7966a8614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:23.302400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d3ede334-ca4c-489b-95f9-c4d7966a8614 None None] MFA Rules not processed for user `e0b66989d4df4398ad723f587cbc24bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:23.303899 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d3ede334-ca4c-489b-95f9-c4d7966a8614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:23.312592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1370/2702] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:23.327046 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910242c-3182-45e1-aba0-8af61adc2ab3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:23.339074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910242c-3182-45e1-aba0-8af61adc2ab3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:23.344091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5818a00-7c27-46bd-9b17-a080a6365aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:23.345229 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5818a00-7c27-46bd-9b17-a080a6365aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:23.345714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5818a00-7c27-46bd-9b17-a080a6365aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:23.346236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5818a00-7c27-46bd-9b17-a080a6365aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:23.357035 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5818a00-7c27-46bd-9b17-a080a6365aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:23.358999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5818a00-7c27-46bd-9b17-a080a6365aa6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:23.364808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:23.372045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1333/2703] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:07:23.481386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013217cb-0369-4a0a-bd8d-54525be13f2b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:23.481386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013217cb-0369-4a0a-bd8d-54525be13f2b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:23.481386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013217cb-0369-4a0a-bd8d-54525be13f2b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:23.481386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1371/2704] 10.222.0.33 () {54 vars in 921 bytes} [Tue Oct 4 09:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 09:07:23.492527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5034-d012-4a9a-9638-b6789d9794e3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:23.492848 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5034-d012-4a9a-9638-b6789d9794e3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:23.493699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5034-d012-4a9a-9638-b6789d9794e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:23.527823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-52dd5034-d012-4a9a-9638-b6789d9794e3 None None] MFA Rules not processed for user `9f31f738fe094e4ea7ed440e661e2111`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:23.529064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-52dd5034-d012-4a9a-9638-b6789d9794e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:23.554899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1334/2705] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Oct 4 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:07:23.567888 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013217cb-0369-4a0a-bd8d-54525be13f2b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:23.608147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013217cb-0369-4a0a-bd8d-54525be13f2b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:23.612546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab75af9-278f-4c57-8470-169e46c85c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:23.613157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab75af9-278f-4c57-8470-169e46c85c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:23.613460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab75af9-278f-4c57-8470-169e46c85c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:23.615065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab75af9-278f-4c57-8470-169e46c85c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:23.628511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab75af9-278f-4c57-8470-169e46c85c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:23.629986 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab75af9-278f-4c57-8470-169e46c85c8d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:23.649957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1372/2706] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:23.726846 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5034-d012-4a9a-9638-b6789d9794e3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:23.728758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-52dd5034-d012-4a9a-9638-b6789d9794e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:23.844558 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d686f-304b-4461-b6b0-101687fef7ac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:23.846300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d686f-304b-4461-b6b0-101687fef7ac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:23.846300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d686f-304b-4461-b6b0-101687fef7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:23.855275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5034-d012-4a9a-9638-b6789d9794e3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:23.864404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20890bc4-61b8-4f0b-96e6-62ba5c1d1e7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:23.865517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20890bc4-61b8-4f0b-96e6-62ba5c1d1e7c service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:23.865847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20890bc4-61b8-4f0b-96e6-62ba5c1d1e7c service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:23.866151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20890bc4-61b8-4f0b-96e6-62ba5c1d1e7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:23.868539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-20890bc4-61b8-4f0b-96e6-62ba5c1d1e7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:23.883344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20890bc4-61b8-4f0b-96e6-62ba5c1d1e7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:23.885068 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20890bc4-61b8-4f0b-96e6-62ba5c1d1e7c service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:23.892137 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4e9d686f-304b-4461-b6b0-101687fef7ac None None] MFA Rules not processed for user `1e4d4c52f73f46f489924537bf67835a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:23.894329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4e9d686f-304b-4461-b6b0-101687fef7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:23.900628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1335/2707] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:23.903435 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:23.981121 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1373/2708] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:07:24.000036 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20890bc4-61b8-4f0b-96e6-62ba5c1d1e7c service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:24.012491 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20890bc4-61b8-4f0b-96e6-62ba5c1d1e7c service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:24.016730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeab722-bd2d-4c3a-aef5-88acbf950d85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8339b6461e4e28bc397dcd3f85e1a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:24.017474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeab722-bd2d-4c3a-aef5-88acbf950d85 service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:24.018062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeab722-bd2d-4c3a-aef5-88acbf950d85 service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:24.025751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeab722-bd2d-4c3a-aef5-88acbf950d85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:24.090932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeab722-bd2d-4c3a-aef5-88acbf950d85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:24.092688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeab722-bd2d-4c3a-aef5-88acbf950d85 service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:24.103001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1336/2709] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:24.352925 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f96627-0f0e-4262-b661-8fe713140411 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:24.353425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f96627-0f0e-4262-b661-8fe713140411 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:24.353768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f96627-0f0e-4262-b661-8fe713140411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:24.374646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-47f96627-0f0e-4262-b661-8fe713140411 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:24.376129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47f96627-0f0e-4262-b661-8fe713140411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:24.435214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1374/2710] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:07:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:24.448826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeab722-bd2d-4c3a-aef5-88acbf950d85 service glance] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:24.450394 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4eeab722-bd2d-4c3a-aef5-88acbf950d85 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:24.543341 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeab722-bd2d-4c3a-aef5-88acbf950d85 service glance] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:24.548443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71b2dd-8db7-47e1-a289-da459afefbb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:24.551613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b2dd-8db7-47e1-a289-da459afefbb2 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:24.551613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b2dd-8db7-47e1-a289-da459afefbb2 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:24.551613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71b2dd-8db7-47e1-a289-da459afefbb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:24.559037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71b2dd-8db7-47e1-a289-da459afefbb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:24.560958 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71b2dd-8db7-47e1-a289-da459afefbb2 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:24.570780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1337/2711] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:07:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:07:24.660535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f96627-0f0e-4262-b661-8fe713140411 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:24.670343 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f96627-0f0e-4262-b661-8fe713140411 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:24.674014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b019eb-c61a-434f-8db2-6572e6fdab79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:24.674650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b019eb-c61a-434f-8db2-6572e6fdab79 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:24.674938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b019eb-c61a-434f-8db2-6572e6fdab79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:24.675214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b019eb-c61a-434f-8db2-6572e6fdab79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:24.677491 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-08b019eb-c61a-434f-8db2-6572e6fdab79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:24.749384 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b019eb-c61a-434f-8db2-6572e6fdab79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:24.752135 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b019eb-c61a-434f-8db2-6572e6fdab79 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:24.769147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1375/2712] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:26.643049 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7463-f6c8-43a6-9d79-bd37fd0ea86f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:26.643556 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7463-f6c8-43a6-9d79-bd37fd0ea86f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:26.643723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7463-f6c8-43a6-9d79-bd37fd0ea86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:26.703501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cffd7463-f6c8-43a6-9d79-bd37fd0ea86f None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:26.705374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cffd7463-f6c8-43a6-9d79-bd37fd0ea86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:26.715526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1338/2713] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:07:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:26.744115 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b019eb-c61a-434f-8db2-6572e6fdab79 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:26.766897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b019eb-c61a-434f-8db2-6572e6fdab79 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:26.802569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596024d-a909-4072-b504-bfee52201329 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:26.809733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596024d-a909-4072-b504-bfee52201329 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:26.810236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596024d-a909-4072-b504-bfee52201329 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:26.810613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596024d-a909-4072-b504-bfee52201329 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:26.836027 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596024d-a909-4072-b504-bfee52201329 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:26.839630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596024d-a909-4072-b504-bfee52201329 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:26.860396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1376/2714] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:07:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:07:31.656984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7463-f6c8-43a6-9d79-bd37fd0ea86f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:31.659004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cffd7463-f6c8-43a6-9d79-bd37fd0ea86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:31.672477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:31.689528 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7463-f6c8-43a6-9d79-bd37fd0ea86f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:31.693660 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:31.694867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:31.696275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:31.697328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] PATH_INFO: `/v3/users/25274e19c10c4e8fb35b37f06e6bfdf8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:31.702880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25274e19c10c4e8fb35b37f06e6bfdf8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:31.706136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:31.977627 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25274e19c10c4e8fb35b37f06e6bfdf8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:31.979338 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25274e19c10c4e8fb35b37f06e6bfdf8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:32.010712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25274e19c10c4e8fb35b37f06e6bfdf8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:32.016730 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25274e19c10c4e8fb35b37f06e6bfdf8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:32.052108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2a952304-79cc-4980-a737-694696f5633c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25274e19c10c4e8fb35b37f06e6bfdf8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:32.151521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1339/2715] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:07:31 2022] DELETE /identity/v3/users/25274e19c10c4e8fb35b37f06e6bfdf8 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:32.943994 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596024d-a909-4072-b504-bfee52201329 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:32.968506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596024d-a909-4072-b504-bfee52201329 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:33.039301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:33.132787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:33.134842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:33.136376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:33.136732 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] PATH_INFO: `/v3/projects/9fdc2cf03b0348adb7805d782f6b0f83` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:33.146287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdc2cf03b0348adb7805d782f6b0f83)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:33.148386 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:33.321966 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdc2cf03b0348adb7805d782f6b0f83', 'request_id': 'req-b6922604-7219-4e94-8ddf-d56a1c74dea0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:33.332479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdc2cf03b0348adb7805d782f6b0f83', 'request_id': 'req-b6922604-7219-4e94-8ddf-d56a1c74dea0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:33.400660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdc2cf03b0348adb7805d782f6b0f83', 'request_id': 'req-b6922604-7219-4e94-8ddf-d56a1c74dea0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:33.431216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] The token cache is being invalidate because project 9fdc2cf03b0348adb7805d782f6b0f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:07:33.434515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:33.436259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b6922604-7219-4e94-8ddf-d56a1c74dea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:33.443527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1377/2716] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:07:32 2022] DELETE /identity/v3/projects/9fdc2cf03b0348adb7805d782f6b0f83 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:33.443756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea104dad-0946-4f02-af2d-d6445ff9d15c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:33.444288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea104dad-0946-4f02-af2d-d6445ff9d15c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:33.444571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea104dad-0946-4f02-af2d-d6445ff9d15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:33.484582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ea104dad-0946-4f02-af2d-d6445ff9d15c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:33.485807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ea104dad-0946-4f02-af2d-d6445ff9d15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:33.636283 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1340/2717] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:33.642797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6ae8-7f9e-4469-8194-bdef61a00ac9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:33.643087 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6ae8-7f9e-4469-8194-bdef61a00ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:33.643369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf6ae8-7f9e-4469-8194-bdef61a00ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:33.678674 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-69cf6ae8-7f9e-4469-8194-bdef61a00ac9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:33.679944 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-69cf6ae8-7f9e-4469-8194-bdef61a00ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:33.700420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1378/2718] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:33.704713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea104dad-0946-4f02-af2d-d6445ff9d15c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:33.721002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea104dad-0946-4f02-af2d-d6445ff9d15c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:33.735919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98bc7a-b593-499b-b9d1-3bcd63453a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:33.739141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98bc7a-b593-499b-b9d1-3bcd63453a16 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:33.740309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98bc7a-b593-499b-b9d1-3bcd63453a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:33.741909 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98bc7a-b593-499b-b9d1-3bcd63453a16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:33.743650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98bc7a-b593-499b-b9d1-3bcd63453a16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:07:33.744200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98bc7a-b593-499b-b9d1-3bcd63453a16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:33.748991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98bc7a-b593-499b-b9d1-3bcd63453a16 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:33.772446 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1341/2719] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:07:33.776600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6ae8-7f9e-4469-8194-bdef61a00ac9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:33.787213 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf6ae8-7f9e-4469-8194-bdef61a00ac9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:33.796280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961e752-d97a-45d5-b547-ef568f24404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:33.796919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961e752-d97a-45d5-b547-ef568f24404d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:33.797204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961e752-d97a-45d5-b547-ef568f24404d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:33.797476 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961e752-d97a-45d5-b547-ef568f24404d admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:33.798169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961e752-d97a-45d5-b547-ef568f24404d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:33.801733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961e752-d97a-45d5-b547-ef568f24404d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:34.122739 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1379/2720] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:07:33 2022] POST /identity/v3/projects => generated 379 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:34.126873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98bc7a-b593-499b-b9d1-3bcd63453a16 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:34.137114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98bc7a-b593-499b-b9d1-3bcd63453a16 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:34.206177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfe60-7531-47d3-bab7-7c3fde1c5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:34.206792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfe60-7531-47d3-bab7-7c3fde1c5efe admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:34.207733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfe60-7531-47d3-bab7-7c3fde1c5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:34.207991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dfe60-7531-47d3-bab7-7c3fde1c5efe admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:34.208675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dfe60-7531-47d3-bab7-7c3fde1c5efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:34.210888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dfe60-7531-47d3-bab7-7c3fde1c5efe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:34.220383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:34.341232 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1342/2721] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:07:34 2022] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:07:34.347202 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961e752-d97a-45d5-b547-ef568f24404d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:34.365344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961e752-d97a-45d5-b547-ef568f24404d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:34.373358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4058ca-f763-4732-a1a0-b355df64b312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:34.380404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4058ca-f763-4732-a1a0-b355df64b312 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:34.380404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4058ca-f763-4732-a1a0-b355df64b312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:34.380404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4058ca-f763-4732-a1a0-b355df64b312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:34.380404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4058ca-f763-4732-a1a0-b355df64b312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:34.380404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4058ca-f763-4732-a1a0-b355df64b312 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:34.400379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfe60-7531-47d3-bab7-7c3fde1c5efe admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:34.412443 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1380/2722] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:34.416593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dfe60-7531-47d3-bab7-7c3fde1c5efe admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:34.421913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11032d-33b3-4aa8-9a7e-0a2c03a8a8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:34.423017 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11032d-33b3-4aa8-9a7e-0a2c03a8a8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:34.423755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11032d-33b3-4aa8-9a7e-0a2c03a8a8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:34.424438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11032d-33b3-4aa8-9a7e-0a2c03a8a8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:34.427015 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11032d-33b3-4aa8-9a7e-0a2c03a8a8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:34.429011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11032d-33b3-4aa8-9a7e-0a2c03a8a8cd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:34.446128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1343/2723] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:34.447365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4058ca-f763-4732-a1a0-b355df64b312 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:34.472771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4058ca-f763-4732-a1a0-b355df64b312 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:34.479290 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c996cf5-035b-432f-af3f-25001cfa59f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:34.481868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c996cf5-035b-432f-af3f-25001cfa59f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:34.482233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c996cf5-035b-432f-af3f-25001cfa59f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:34.482562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c996cf5-035b-432f-af3f-25001cfa59f1 admin admin] PATH_INFO: `/v3/projects/e7d0cfdce91c4762b1ccb542582d1e9a/users/87f33b7f0afb4aa485cdb06b02bce5f3/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:34.509639 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c996cf5-035b-432f-af3f-25001cfa59f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d0cfdce91c4762b1ccb542582d1e9a, user_id=87f33b7f0afb4aa485cdb06b02bce5f3, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:34.513089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c996cf5-035b-432f-af3f-25001cfa59f1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:34.604807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1381/2724] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:34 2022] PUT /identity/v3/projects/e7d0cfdce91c4762b1ccb542582d1e9a/users/87f33b7f0afb4aa485cdb06b02bce5f3/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:34.613517 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eecc9c-3350-471c-9ceb-ab7738ed391d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:34.613810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eecc9c-3350-471c-9ceb-ab7738ed391d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:34.614119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eecc9c-3350-471c-9ceb-ab7738ed391d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:34.674251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c0eecc9c-3350-471c-9ceb-ab7738ed391d None None] MFA Rules not processed for user `87f33b7f0afb4aa485cdb06b02bce5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:34.676536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c0eecc9c-3350-471c-9ceb-ab7738ed391d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:34.805789 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1344/2725] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:34.810400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c996cf5-035b-432f-af3f-25001cfa59f1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:34.941480 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:34.952878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c996cf5-035b-432f-af3f-25001cfa59f1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:34.966769 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d06ce-34cd-4b6a-ab28-8413269a4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:34.967574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d06ce-34cd-4b6a-ab28-8413269a4c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:34.967868 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d06ce-34cd-4b6a-ab28-8413269a4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:34.968166 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d06ce-34cd-4b6a-ab28-8413269a4c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:34.968850 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d06ce-34cd-4b6a-ab28-8413269a4c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:34.971048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d06ce-34cd-4b6a-ab28-8413269a4c90 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:35.088666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1382/2726] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:07:34 2022] POST /identity/v3/projects => generated 379 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:35.090747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eecc9c-3350-471c-9ceb-ab7738ed391d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:35.127847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eecc9c-3350-471c-9ceb-ab7738ed391d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:35.268474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53943-03c7-46a1-958a-3d1fb0597197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:35.270147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53943-03c7-46a1-958a-3d1fb0597197 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:35.270782 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53943-03c7-46a1-958a-3d1fb0597197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:35.271536 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b53943-03c7-46a1-958a-3d1fb0597197 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:35.272407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53943-03c7-46a1-958a-3d1fb0597197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:35.274957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b53943-03c7-46a1-958a-3d1fb0597197 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:35.395600 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1345/2727] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:07:35 2022] POST /identity/v3/users => generated 296 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:35.397479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d06ce-34cd-4b6a-ab28-8413269a4c90 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:35.427134 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d06ce-34cd-4b6a-ab28-8413269a4c90 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:35.444599 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83684c64-1605-4240-8d44-d1910521e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:35.445562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684c64-1605-4240-8d44-d1910521e9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:35.446029 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684c64-1605-4240-8d44-d1910521e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:35.446526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684c64-1605-4240-8d44-d1910521e9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:35.447603 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83684c64-1605-4240-8d44-d1910521e9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:35.450446 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83684c64-1605-4240-8d44-d1910521e9b9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:35.495912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1383/2728] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:35.497216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53943-03c7-46a1-958a-3d1fb0597197 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:35.510749 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b53943-03c7-46a1-958a-3d1fb0597197 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:35.525483 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b8f54-5bdf-4e17-995d-a5bbef747239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:35.528887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b8f54-5bdf-4e17-995d-a5bbef747239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:35.529956 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b8f54-5bdf-4e17-995d-a5bbef747239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:35.530379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b8f54-5bdf-4e17-995d-a5bbef747239 admin admin] PATH_INFO: `/v3/projects/0fdf0c0dbdaf440faf104c754a858144/users/72ab09b745d440e18198a937b2245e58/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:35.571061 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b8f54-5bdf-4e17-995d-a5bbef747239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fdf0c0dbdaf440faf104c754a858144, user_id=72ab09b745d440e18198a937b2245e58, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:35.576175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b8f54-5bdf-4e17-995d-a5bbef747239 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:35.660296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1346/2729] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:35 2022] PUT /identity/v3/projects/0fdf0c0dbdaf440faf104c754a858144/users/72ab09b745d440e18198a937b2245e58/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:07:35.666416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83684c64-1605-4240-8d44-d1910521e9b9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:35.683711 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83684c64-1605-4240-8d44-d1910521e9b9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:35.909740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e1e54-f97c-46b0-a03a-2c5f35d98815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:35.910910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e1e54-f97c-46b0-a03a-2c5f35d98815 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:35.911313 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e1e54-f97c-46b0-a03a-2c5f35d98815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:35.911795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e1e54-f97c-46b0-a03a-2c5f35d98815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:35.913040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e1e54-f97c-46b0-a03a-2c5f35d98815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:35.916527 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e1e54-f97c-46b0-a03a-2c5f35d98815 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:35.949694 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1384/2730] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:35.950798 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b8f54-5bdf-4e17-995d-a5bbef747239 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:36.015106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b8f54-5bdf-4e17-995d-a5bbef747239 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:36.037236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef897d-1626-4f6a-a923-5f0ec5609148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:36.038377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef897d-1626-4f6a-a923-5f0ec5609148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:36.038884 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef897d-1626-4f6a-a923-5f0ec5609148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:36.039397 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef897d-1626-4f6a-a923-5f0ec5609148 admin admin] PATH_INFO: `/v3/projects/0fdf0c0dbdaf440faf104c754a858144/users/72ab09b745d440e18198a937b2245e58/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:36.052503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef897d-1626-4f6a-a923-5f0ec5609148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fdf0c0dbdaf440faf104c754a858144, user_id=72ab09b745d440e18198a937b2245e58, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:36.057922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef897d-1626-4f6a-a923-5f0ec5609148 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:36.110603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1347/2731] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:35 2022] PUT /identity/v3/projects/0fdf0c0dbdaf440faf104c754a858144/users/72ab09b745d440e18198a937b2245e58/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:07:36.119207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28838f25-d5d2-4623-9d24-a4120f698534 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:36.119645 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28838f25-d5d2-4623-9d24-a4120f698534 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:36.120057 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28838f25-d5d2-4623-9d24-a4120f698534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:36.161676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-28838f25-d5d2-4623-9d24-a4120f698534 None None] MFA Rules not processed for user `72ab09b745d440e18198a937b2245e58`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:36.164902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-28838f25-d5d2-4623-9d24-a4120f698534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:36.308050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1385/2732] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:36.339010 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef897d-1626-4f6a-a923-5f0ec5609148 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:36.340991 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a0ef897d-1626-4f6a-a923-5f0ec5609148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:36.390184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:36.481665 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef897d-1626-4f6a-a923-5f0ec5609148 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:36.494367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85afb2-e3a7-4dca-a175-44f9a171d45e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:36.495785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85afb2-e3a7-4dca-a175-44f9a171d45e service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:36.496366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85afb2-e3a7-4dca-a175-44f9a171d45e service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:36.497107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85afb2-e3a7-4dca-a175-44f9a171d45e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:36.515572 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85afb2-e3a7-4dca-a175-44f9a171d45e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:36.531073 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85afb2-e3a7-4dca-a175-44f9a171d45e service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:36.531368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1348/2733] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:37.262771 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28838f25-d5d2-4623-9d24-a4120f698534 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:37.264951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-28838f25-d5d2-4623-9d24-a4120f698534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:37.340680 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:37.393259 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28838f25-d5d2-4623-9d24-a4120f698534 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:37.399463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1593bc-993b-4f76-affd-a8fc6bff8f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:37.400084 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1593bc-993b-4f76-affd-a8fc6bff8f3d service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:37.400378 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1593bc-993b-4f76-affd-a8fc6bff8f3d service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:37.400642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1593bc-993b-4f76-affd-a8fc6bff8f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:37.402550 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb1593bc-993b-4f76-affd-a8fc6bff8f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:37.478598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1593bc-993b-4f76-affd-a8fc6bff8f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:37.480284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1593bc-993b-4f76-affd-a8fc6bff8f3d service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:37.501154 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1386/2734] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:37.654287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85afb2-e3a7-4dca-a175-44f9a171d45e service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:37.672328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85afb2-e3a7-4dca-a175-44f9a171d45e service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:37.690492 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe69d2c-ea9c-424d-b262-b4d9625ba05d tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ab09b745d440e18198a937b2245e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fdf0c0dbdaf440faf104c754a858144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:37.692651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe69d2c-ea9c-424d-b262-b4d9625ba05d tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:37.694409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe69d2c-ea9c-424d-b262-b4d9625ba05d tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:37.695090 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe69d2c-ea9c-424d-b262-b4d9625ba05d tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:37.702895 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe69d2c-ea9c-424d-b262-b4d9625ba05d tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:07:37.703650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe69d2c-ea9c-424d-b262-b4d9625ba05d tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:37.708419 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe69d2c-ea9c-424d-b262-b4d9625ba05d tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:37.730940 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1349/2735] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:07:37.735033 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1593bc-993b-4f76-affd-a8fc6bff8f3d service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:37.760965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1593bc-993b-4f76-affd-a8fc6bff8f3d service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:37.782857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0402-1eba-47f0-97d4-1e88336438c1 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ab09b745d440e18198a937b2245e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fdf0c0dbdaf440faf104c754a858144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:37.783498 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0402-1eba-47f0-97d4-1e88336438c1 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:37.783930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0402-1eba-47f0-97d4-1e88336438c1 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:37.784217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e0402-1eba-47f0-97d4-1e88336438c1 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:37.785523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e0402-1eba-47f0-97d4-1e88336438c1 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:37.787502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e0402-1eba-47f0-97d4-1e88336438c1 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:37.924801 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1387/2736] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:07:37 2022] POST /identity/v3/projects => generated 353 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:07:37.930053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe69d2c-ea9c-424d-b262-b4d9625ba05d tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:37.956543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe69d2c-ea9c-424d-b262-b4d9625ba05d tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:38.102441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ab09b745d440e18198a937b2245e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fdf0c0dbdaf440faf104c754a858144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:38.103185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:38.103570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:38.103899 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:38.104547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:07:38.104855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:38.117011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:38.135367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1350/2737] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:07:38.188573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0402-1eba-47f0-97d4-1e88336438c1 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:38.199574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e0402-1eba-47f0-97d4-1e88336438c1 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:38.210993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72ab09b745d440e18198a937b2245e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fdf0c0dbdaf440faf104c754a858144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:38.211679 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:38.212002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:38.212268 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] PATH_INFO: `/v3/projects/bc6c57099a954edcad14fc18694d8318` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:38.215619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc6c57099a954edcad14fc18694d8318)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:38.217548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:38.402136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6c57099a954edcad14fc18694d8318', 'request_id': 'req-0d419fda-63e7-43b8-a518-da5b255fc080'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:38.402136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6c57099a954edcad14fc18694d8318', 'request_id': 'req-0d419fda-63e7-43b8-a518-da5b255fc080'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:38.497355 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6c57099a954edcad14fc18694d8318', 'request_id': 'req-0d419fda-63e7-43b8-a518-da5b255fc080'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:38.526582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] The token cache is being invalidate because project bc6c57099a954edcad14fc18694d8318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:07:38.527096 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:38.529626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d419fda-63e7-43b8-a518-da5b255fc080 tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:38.532051 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1388/2738] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:07:38 2022] DELETE /identity/v3/projects/bc6c57099a954edcad14fc18694d8318 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:07:39.300793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:39.305527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:39.439260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb62906-ac77-4350-80f9-b1f5d5237a5c tempest-VolumeQuotaClassesTest-611756730 tempest-VolumeQuotaClassesTest-611756730-project-admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:39.542490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:39.552618 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:39.556147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:39.556147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:39.556147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] PATH_INFO: `/v3/users/87f33b7f0afb4aa485cdb06b02bce5f3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:39.556147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f33b7f0afb4aa485cdb06b02bce5f3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:39.557125 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:39.828199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f33b7f0afb4aa485cdb06b02bce5f3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:39.828995 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f33b7f0afb4aa485cdb06b02bce5f3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:39.839567 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f33b7f0afb4aa485cdb06b02bce5f3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:39.840435 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f33b7f0afb4aa485cdb06b02bce5f3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:39.853999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f33b7f0afb4aa485cdb06b02bce5f3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:39.930189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1351/2739] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:07:39 2022] DELETE /identity/v3/users/87f33b7f0afb4aa485cdb06b02bce5f3 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:39.935243 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b46530-181f-4772-a4e0-b311e0ca0725 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:39.936144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b46530-181f-4772-a4e0-b311e0ca0725 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:39.936817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b46530-181f-4772-a4e0-b311e0ca0725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:39.982028 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c7b46530-181f-4772-a4e0-b311e0ca0725 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:39.987200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c7b46530-181f-4772-a4e0-b311e0ca0725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:40.033938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:40.048525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1389/2740] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:40.059415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:40.060813 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:40.128752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c04b8-5f5d-4ee1-bc52-51aa532afb39 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:40.132604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d10174-63a2-4c1a-b91a-f8dfc813ad22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:40.133296 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d10174-63a2-4c1a-b91a-f8dfc813ad22 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:40.133682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d10174-63a2-4c1a-b91a-f8dfc813ad22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:40.134025 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d10174-63a2-4c1a-b91a-f8dfc813ad22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:40.144310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d10174-63a2-4c1a-b91a-f8dfc813ad22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:40.146355 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d10174-63a2-4c1a-b91a-f8dfc813ad22 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:40.156088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1352/2741] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:40.317705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a695ef-b302-4c26-b449-5a0863b1ea74 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:40.317992 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a695ef-b302-4c26-b449-5a0863b1ea74 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:40.318299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a695ef-b302-4c26-b449-5a0863b1ea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:40.337614 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-70a695ef-b302-4c26-b449-5a0863b1ea74 None None] MFA Rules not processed for user `8cdfe162e5c2471ba9fd239ab82789a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:40.339021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-70a695ef-b302-4c26-b449-5a0863b1ea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:40.407181 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1390/2742] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:40.618213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d10174-63a2-4c1a-b91a-f8dfc813ad22 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:40.619825 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-91d10174-63a2-4c1a-b91a-f8dfc813ad22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:40.632885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d10174-63a2-4c1a-b91a-f8dfc813ad22 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:40.637542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:40.638203 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:40.638612 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:40.638806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] PATH_INFO: `/v3/projects/e7d0cfdce91c4762b1ccb542582d1e9a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:40.639932 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d0cfdce91c4762b1ccb542582d1e9a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:40.641911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:40.779253 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d0cfdce91c4762b1ccb542582d1e9a', 'request_id': 'req-4f079d7c-64f0-46f5-b16d-42d320d03410'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:40.787988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d0cfdce91c4762b1ccb542582d1e9a', 'request_id': 'req-4f079d7c-64f0-46f5-b16d-42d320d03410'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:40.796583 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d0cfdce91c4762b1ccb542582d1e9a', 'request_id': 'req-4f079d7c-64f0-46f5-b16d-42d320d03410'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:40.886911 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:40.891839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] The token cache is being invalidate because project e7d0cfdce91c4762b1ccb542582d1e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:07:40.892198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:40.892841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:40.894898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1353/2743] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:07:40 2022] DELETE /identity/v3/projects/e7d0cfdce91c4762b1ccb542582d1e9a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:40.899043 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a695ef-b302-4c26-b449-5a0863b1ea74 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:40.909911 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a695ef-b302-4c26-b449-5a0863b1ea74 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:40.970847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:40.971531 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:40.971747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:40.972022 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] PATH_INFO: `/v3/users/72ab09b745d440e18198a937b2245e58` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:40.973144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ab09b745d440e18198a937b2245e58)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:40.975106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:41.162376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ab09b745d440e18198a937b2245e58'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:41.163116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ab09b745d440e18198a937b2245e58'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:41.171280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ab09b745d440e18198a937b2245e58'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:41.263147 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ab09b745d440e18198a937b2245e58'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:41.263863 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-fb8f98f8-cbd4-493f-bd22-9b95f4e36e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ab09b745d440e18198a937b2245e58'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:41.282415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1391/2744] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:07:40 2022] DELETE /identity/v3/users/72ab09b745d440e18198a937b2245e58 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:07:41.736738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:41.738767 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:41.752085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f079d7c-64f0-46f5-b16d-42d320d03410 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:41.810112 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:41.810760 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:41.811043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:41.811319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] PATH_INFO: `/v3/projects/0fdf0c0dbdaf440faf104c754a858144` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:41.812438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fdf0c0dbdaf440faf104c754a858144)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:41.814402 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:41.925082 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fdf0c0dbdaf440faf104c754a858144', 'request_id': 'req-a909f89e-7fc3-4f41-9857-6b286b963935'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:41.931387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fdf0c0dbdaf440faf104c754a858144', 'request_id': 'req-a909f89e-7fc3-4f41-9857-6b286b963935'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:41.937393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fdf0c0dbdaf440faf104c754a858144', 'request_id': 'req-a909f89e-7fc3-4f41-9857-6b286b963935'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:42.004972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] The token cache is being invalidate because project 0fdf0c0dbdaf440faf104c754a858144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:07:42.005206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:42.005858 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a909f89e-7fc3-4f41-9857-6b286b963935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:42.007371 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1354/2745] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:07:41 2022] DELETE /identity/v3/projects/0fdf0c0dbdaf440faf104c754a858144 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:42.013013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f62f1-ca98-4dfc-a7f4-3fab18b6cdb7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.013483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f62f1-ca98-4dfc-a7f4-3fab18b6cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.013590 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f62f1-ca98-4dfc-a7f4-3fab18b6cdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.033598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fb2f62f1-ca98-4dfc-a7f4-3fab18b6cdb7 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:42.037996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fb2f62f1-ca98-4dfc-a7f4-3fab18b6cdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:42.041609 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:42.095812 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1392/2746] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:42.104105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf587c5-6b2a-4422-b063-32cc2e674c68 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.104400 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf587c5-6b2a-4422-b063-32cc2e674c68 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.104677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf587c5-6b2a-4422-b063-32cc2e674c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.127950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4bf587c5-6b2a-4422-b063-32cc2e674c68 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:42.129169 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4bf587c5-6b2a-4422-b063-32cc2e674c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:42.137498 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1355/2747] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:42.141844 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f62f1-ca98-4dfc-a7f4-3fab18b6cdb7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:42.152165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f62f1-ca98-4dfc-a7f4-3fab18b6cdb7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:42.157040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f71d50-9666-49f6-858e-a34ea425cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:42.157631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f71d50-9666-49f6-858e-a34ea425cf2f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.157910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f71d50-9666-49f6-858e-a34ea425cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.158263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f71d50-9666-49f6-858e-a34ea425cf2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.158975 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f71d50-9666-49f6-858e-a34ea425cf2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:07:42.159267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f71d50-9666-49f6-858e-a34ea425cf2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:42.161978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f71d50-9666-49f6-858e-a34ea425cf2f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:42.178484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1393/2748] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:07:42.179688 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf587c5-6b2a-4422-b063-32cc2e674c68 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:42.191161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf587c5-6b2a-4422-b063-32cc2e674c68 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:42.195930 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4b0e-6b57-48ec-9830-ccc1f8eb1315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:42.196582 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4b0e-6b57-48ec-9830-ccc1f8eb1315 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.197032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4b0e-6b57-48ec-9830-ccc1f8eb1315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.197313 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df4b0e-6b57-48ec-9830-ccc1f8eb1315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.197983 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df4b0e-6b57-48ec-9830-ccc1f8eb1315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:42.199938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df4b0e-6b57-48ec-9830-ccc1f8eb1315 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:42.304258 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1356/2749] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:07:42 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:07:42.308232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f71d50-9666-49f6-858e-a34ea425cf2f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:42.318566 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f71d50-9666-49f6-858e-a34ea425cf2f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:42.372970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c53195-df20-43d8-a1d9-4eeb76d25477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:42.373569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53195-df20-43d8-a1d9-4eeb76d25477 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.373894 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53195-df20-43d8-a1d9-4eeb76d25477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.374146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53195-df20-43d8-a1d9-4eeb76d25477 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.374830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c53195-df20-43d8-a1d9-4eeb76d25477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:42.376758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c53195-df20-43d8-a1d9-4eeb76d25477 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:42.486552 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1394/2750] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:07:42 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:42.491952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4b0e-6b57-48ec-9830-ccc1f8eb1315 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:42.500768 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df4b0e-6b57-48ec-9830-ccc1f8eb1315 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:42.505973 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c54813-3ee5-44d1-b6b9-3daf483a20f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:42.506619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c54813-3ee5-44d1-b6b9-3daf483a20f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.506904 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c54813-3ee5-44d1-b6b9-3daf483a20f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.507172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c54813-3ee5-44d1-b6b9-3daf483a20f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.507824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c54813-3ee5-44d1-b6b9-3daf483a20f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:42.509436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c54813-3ee5-44d1-b6b9-3daf483a20f1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:42.523690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1357/2751] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:42.525560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c53195-df20-43d8-a1d9-4eeb76d25477 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:42.536511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c53195-df20-43d8-a1d9-4eeb76d25477 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:42.542551 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77212f0-4a30-4d84-9108-ae7d17a5ce7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:42.543263 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77212f0-4a30-4d84-9108-ae7d17a5ce7a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.543658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77212f0-4a30-4d84-9108-ae7d17a5ce7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.544046 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77212f0-4a30-4d84-9108-ae7d17a5ce7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.544793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77212f0-4a30-4d84-9108-ae7d17a5ce7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:42.546548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77212f0-4a30-4d84-9108-ae7d17a5ce7a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:42.559136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1395/2752] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:42.568187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c54813-3ee5-44d1-b6b9-3daf483a20f1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:42.578474 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c54813-3ee5-44d1-b6b9-3daf483a20f1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:42.583696 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72f00a-7c82-49d0-93b3-e9b1d838667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:42.588962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72f00a-7c82-49d0-93b3-e9b1d838667e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.588962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72f00a-7c82-49d0-93b3-e9b1d838667e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.588962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72f00a-7c82-49d0-93b3-e9b1d838667e admin admin] PATH_INFO: `/v3/projects/2e9cd72db3ad426583671512fe7e8e80/users/155b364b4f474b27b642b6202e9a5cfe/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.599214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72f00a-7c82-49d0-93b3-e9b1d838667e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9cd72db3ad426583671512fe7e8e80, user_id=155b364b4f474b27b642b6202e9a5cfe, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:42.601853 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72f00a-7c82-49d0-93b3-e9b1d838667e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:42.697543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1358/2753] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:42 2022] PUT /identity/v3/projects/2e9cd72db3ad426583671512fe7e8e80/users/155b364b4f474b27b642b6202e9a5cfe/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:42.707691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07d48f-79bd-416a-bffc-7f0492d296d7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.707983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07d48f-79bd-416a-bffc-7f0492d296d7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.708261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07d48f-79bd-416a-bffc-7f0492d296d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.736364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ec07d48f-79bd-416a-bffc-7f0492d296d7 None None] MFA Rules not processed for user `155b364b4f474b27b642b6202e9a5cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:42.737575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec07d48f-79bd-416a-bffc-7f0492d296d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:42.802983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1396/2754] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:07:42.807593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72f00a-7c82-49d0-93b3-e9b1d838667e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:42.834967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:42.870207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72f00a-7c82-49d0-93b3-e9b1d838667e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:42.882808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bcd20-f4bc-4b09-a07a-efa4c45eac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:42.882808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bcd20-f4bc-4b09-a07a-efa4c45eac25 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:42.882808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bcd20-f4bc-4b09-a07a-efa4c45eac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:42.882808 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bcd20-f4bc-4b09-a07a-efa4c45eac25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:42.883184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bcd20-f4bc-4b09-a07a-efa4c45eac25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:42.883563 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bcd20-f4bc-4b09-a07a-efa4c45eac25 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:42.987873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1359/2755] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:07:42 2022] POST /identity/v3/projects => generated 389 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:07:42.992364 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07d48f-79bd-416a-bffc-7f0492d296d7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:43.003686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07d48f-79bd-416a-bffc-7f0492d296d7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:43.007763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:43.059701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bf067-b852-479b-adbf-128574254d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:43.060444 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf067-b852-479b-adbf-128574254d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.060576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf067-b852-479b-adbf-128574254d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.060849 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf067-b852-479b-adbf-128574254d5d admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.061474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bf067-b852-479b-adbf-128574254d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:43.063425 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bf067-b852-479b-adbf-128574254d5d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:43.168676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1397/2756] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:07:42 2022] POST /identity/v3/users => generated 301 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:43.171211 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bcd20-f4bc-4b09-a07a-efa4c45eac25 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:43.182472 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bcd20-f4bc-4b09-a07a-efa4c45eac25 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:43.187178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3696858-db45-4f12-8884-42a2f19a77a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:43.187779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3696858-db45-4f12-8884-42a2f19a77a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.188064 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3696858-db45-4f12-8884-42a2f19a77a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.188360 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3696858-db45-4f12-8884-42a2f19a77a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.188999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3696858-db45-4f12-8884-42a2f19a77a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:43.190645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3696858-db45-4f12-8884-42a2f19a77a4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:43.202238 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1360/2757] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:07:43.206394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bf067-b852-479b-adbf-128574254d5d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:43.216445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bf067-b852-479b-adbf-128574254d5d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:43.221001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad9e1-a7ad-46f1-987a-b67a86c5411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:43.221990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad9e1-a7ad-46f1-987a-b67a86c5411b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.221990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad9e1-a7ad-46f1-987a-b67a86c5411b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.222200 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad9e1-a7ad-46f1-987a-b67a86c5411b admin admin] PATH_INFO: `/v3/projects/0f952f56d8614ae89cb9d72f2c55622f/users/c10e4d7bab22402fb55c9bb7d6b066ff/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.240473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ad9e1-a7ad-46f1-987a-b67a86c5411b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f952f56d8614ae89cb9d72f2c55622f, user_id=c10e4d7bab22402fb55c9bb7d6b066ff, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:43.243172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ad9e1-a7ad-46f1-987a-b67a86c5411b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:43.303941 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1398/2758] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:43 2022] PUT /identity/v3/projects/0f952f56d8614ae89cb9d72f2c55622f/users/c10e4d7bab22402fb55c9bb7d6b066ff/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:43.308092 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3696858-db45-4f12-8884-42a2f19a77a4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:43.319348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3696858-db45-4f12-8884-42a2f19a77a4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:43.398366 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b489f-48bd-4617-9b7f-e75d1888cbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:43.399004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b489f-48bd-4617-9b7f-e75d1888cbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.399290 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b489f-48bd-4617-9b7f-e75d1888cbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.399566 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b489f-48bd-4617-9b7f-e75d1888cbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.400250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b489f-48bd-4617-9b7f-e75d1888cbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:43.401960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b489f-48bd-4617-9b7f-e75d1888cbd2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:43.412571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1361/2759] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:43.416917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad9e1-a7ad-46f1-987a-b67a86c5411b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:43.427363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad9e1-a7ad-46f1-987a-b67a86c5411b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:43.431913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a066d-9721-4aca-af47-f6f1e7bc852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:43.432565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a066d-9721-4aca-af47-f6f1e7bc852f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.432851 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a066d-9721-4aca-af47-f6f1e7bc852f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.433127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a066d-9721-4aca-af47-f6f1e7bc852f admin admin] PATH_INFO: `/v3/projects/0f952f56d8614ae89cb9d72f2c55622f/users/c10e4d7bab22402fb55c9bb7d6b066ff/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.435092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a066d-9721-4aca-af47-f6f1e7bc852f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f952f56d8614ae89cb9d72f2c55622f, user_id=c10e4d7bab22402fb55c9bb7d6b066ff, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:43.437983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a066d-9721-4aca-af47-f6f1e7bc852f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:43.448516 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1399/2760] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:43 2022] PUT /identity/v3/projects/0f952f56d8614ae89cb9d72f2c55622f/users/c10e4d7bab22402fb55c9bb7d6b066ff/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:43.460962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d819db-8c48-4821-8d99-993fa0c3dad2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.461438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d819db-8c48-4821-8d99-993fa0c3dad2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.462122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d819db-8c48-4821-8d99-993fa0c3dad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.494443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-05d819db-8c48-4821-8d99-993fa0c3dad2 None None] MFA Rules not processed for user `c10e4d7bab22402fb55c9bb7d6b066ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:43.495744 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05d819db-8c48-4821-8d99-993fa0c3dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:43.566384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1362/2761] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:43 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:43.577065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a066d-9721-4aca-af47-f6f1e7bc852f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:43.578800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5c2a066d-9721-4aca-af47-f6f1e7bc852f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:43.646214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a066d-9721-4aca-af47-f6f1e7bc852f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:43.650066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11d404-3019-43a2-8199-8ec6c2e34ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:43.650630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11d404-3019-43a2-8199-8ec6c2e34ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.661158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11d404-3019-43a2-8199-8ec6c2e34ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.661158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11d404-3019-43a2-8199-8ec6c2e34ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.664318 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11d404-3019-43a2-8199-8ec6c2e34ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:43.666129 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11d404-3019-43a2-8199-8ec6c2e34ff1 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:43.677487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1400/2762] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:43.753854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a3188-6b66-4dc0-9a4a-eaed7dee7b92 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.754729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a3188-6b66-4dc0-9a4a-eaed7dee7b92 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.755007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a3188-6b66-4dc0-9a4a-eaed7dee7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.780148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3f3a3188-6b66-4dc0-9a4a-eaed7dee7b92 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:43.781521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f3a3188-6b66-4dc0-9a4a-eaed7dee7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:43.796677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:43.827447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11d404-3019-43a2-8199-8ec6c2e34ff1 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:43.845908 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1363/2763] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Oct 4 09:07:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:43.860545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a3188-6b66-4dc0-9a4a-eaed7dee7b92 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:43.863842 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f3a3188-6b66-4dc0-9a4a-eaed7dee7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:43.931567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11d404-3019-43a2-8199-8ec6c2e34ff1 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:43.934677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:43.935493 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.935859 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.936215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] PATH_INFO: `/v3/users/155b364b4f474b27b642b6202e9a5cfe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.938103 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] RBAC: Authorizing `identity:delete_user(user_id=155b364b4f474b27b642b6202e9a5cfe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:43.945167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:43.946413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:43.967733 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a3188-6b66-4dc0-9a4a-eaed7dee7b92 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:43.977931 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77058ac9-0bfe-4863-b452-eff8a06fbca9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:43.978616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77058ac9-0bfe-4863-b452-eff8a06fbca9 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:43.978901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77058ac9-0bfe-4863-b452-eff8a06fbca9 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:43.979184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77058ac9-0bfe-4863-b452-eff8a06fbca9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:43.988227 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77058ac9-0bfe-4863-b452-eff8a06fbca9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:43.989867 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77058ac9-0bfe-4863-b452-eff8a06fbca9 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:43.998570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1364/2764] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:07:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 09:07:44.253374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155b364b4f474b27b642b6202e9a5cfe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:44.255285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155b364b4f474b27b642b6202e9a5cfe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:44.268654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155b364b4f474b27b642b6202e9a5cfe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:44.366119 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155b364b4f474b27b642b6202e9a5cfe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:44.367281 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155b364b4f474b27b642b6202e9a5cfe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:44.417329 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1401/2765] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:07:43 2022] DELETE /identity/v3/users/155b364b4f474b27b642b6202e9a5cfe => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:07:44.422124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44f921-cce3-429c-a3fb-73259d5f161c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:44.422476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44f921-cce3-429c-a3fb-73259d5f161c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:44.422823 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44f921-cce3-429c-a3fb-73259d5f161c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:44.469291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ec44f921-cce3-429c-a3fb-73259d5f161c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:44.472810 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ec44f921-cce3-429c-a3fb-73259d5f161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:44.631545 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1365/2766] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:44.641789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:44.643451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:44.779368 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163fc32-abec-425d-8698-ed258c2221df admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:44.790481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce2eb-bc53-4fdc-ae93-a89a7ec63bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:44.791415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce2eb-bc53-4fdc-ae93-a89a7ec63bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:44.791720 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce2eb-bc53-4fdc-ae93-a89a7ec63bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:44.792483 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce2eb-bc53-4fdc-ae93-a89a7ec63bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:44.818039 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce2eb-bc53-4fdc-ae93-a89a7ec63bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:44.820882 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce2eb-bc53-4fdc-ae93-a89a7ec63bb9 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:44.851726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1402/2767] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:45.489361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44f921-cce3-429c-a3fb-73259d5f161c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:45.491495 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ec44f921-cce3-429c-a3fb-73259d5f161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:45.504994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44f921-cce3-429c-a3fb-73259d5f161c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:45.521343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:45.522955 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:45.523518 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:45.524072 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] PATH_INFO: `/v3/projects/2e9cd72db3ad426583671512fe7e8e80` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:45.525531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9cd72db3ad426583671512fe7e8e80)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:45.528613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:45.686742 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9cd72db3ad426583671512fe7e8e80', 'request_id': 'req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:45.690617 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:45.698173 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9cd72db3ad426583671512fe7e8e80', 'request_id': 'req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:45.713188 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9cd72db3ad426583671512fe7e8e80', 'request_id': 'req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:45.824726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] The token cache is being invalidate because project 2e9cd72db3ad426583671512fe7e8e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:07:45.825234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:45.826407 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:45.831187 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1366/2768] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:07:45 2022] DELETE /identity/v3/projects/2e9cd72db3ad426583671512fe7e8e80 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:07:45.833821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce2eb-bc53-4fdc-ae93-a89a7ec63bb9 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:45.847251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce2eb-bc53-4fdc-ae93-a89a7ec63bb9 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:46.002636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:46.007745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:46.008047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:46.008330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] PATH_INFO: `/v3/users/c10e4d7bab22402fb55c9bb7d6b066ff` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:46.009767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10e4d7bab22402fb55c9bb7d6b066ff)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:46.011864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:46.144262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:46.245011 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10e4d7bab22402fb55c9bb7d6b066ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:46.246048 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10e4d7bab22402fb55c9bb7d6b066ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:46.272436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10e4d7bab22402fb55c9bb7d6b066ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:47.432760 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10e4d7bab22402fb55c9bb7d6b066ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:47.433575 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8d59b2f6-c3a7-4f9c-bebc-03cd312ad52c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10e4d7bab22402fb55c9bb7d6b066ff'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:47.459637 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1403/2769] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:07:45 2022] DELETE /identity/v3/users/c10e4d7bab22402fb55c9bb7d6b066ff => generated 0 bytes in 1626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:48.260344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:48.261966 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:48.278339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa32e0c-b93f-4dbd-b4a7-3c1314af1e11 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:48.352727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:48.353745 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:48.354397 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:48.354881 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] PATH_INFO: `/v3/projects/0f952f56d8614ae89cb9d72f2c55622f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:48.356269 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f952f56d8614ae89cb9d72f2c55622f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:48.358752 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:48.472238 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f952f56d8614ae89cb9d72f2c55622f', 'request_id': 'req-c5275a32-9208-482d-b1d7-e0cd31e396d9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:48.484503 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f952f56d8614ae89cb9d72f2c55622f', 'request_id': 'req-c5275a32-9208-482d-b1d7-e0cd31e396d9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:48.492675 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f952f56d8614ae89cb9d72f2c55622f', 'request_id': 'req-c5275a32-9208-482d-b1d7-e0cd31e396d9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:48.574830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] The token cache is being invalidate because project 0f952f56d8614ae89cb9d72f2c55622f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:07:48.575176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:48.575866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c5275a32-9208-482d-b1d7-e0cd31e396d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:07:48.577571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1367/2770] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:07:48 2022] DELETE /identity/v3/projects/0f952f56d8614ae89cb9d72f2c55622f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:48.582583 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab392d9-1dc9-42b9-82c0-7ba445093d63 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:48.583092 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab392d9-1dc9-42b9-82c0-7ba445093d63 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:48.583206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab392d9-1dc9-42b9-82c0-7ba445093d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:48.604882 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fab392d9-1dc9-42b9-82c0-7ba445093d63 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:48.606127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fab392d9-1dc9-42b9-82c0-7ba445093d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:48.671003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1404/2771] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:48.679392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b80ba-9915-48c9-ba2f-41324e2102f1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:48.679712 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b80ba-9915-48c9-ba2f-41324e2102f1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:48.679993 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b80ba-9915-48c9-ba2f-41324e2102f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:48.701804 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b29b80ba-9915-48c9-ba2f-41324e2102f1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:48.703390 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b29b80ba-9915-48c9-ba2f-41324e2102f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:48.713984 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1368/2772] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:48.716805 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab392d9-1dc9-42b9-82c0-7ba445093d63 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:48.727178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab392d9-1dc9-42b9-82c0-7ba445093d63 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:48.732068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcefa6d-e580-4478-b51b-651d40bf091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:48.732886 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcefa6d-e580-4478-b51b-651d40bf091c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:48.733251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcefa6d-e580-4478-b51b-651d40bf091c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:48.733613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcefa6d-e580-4478-b51b-651d40bf091c admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:48.734427 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcefa6d-e580-4478-b51b-651d40bf091c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:07:48.734934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcefa6d-e580-4478-b51b-651d40bf091c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:48.736990 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcefa6d-e580-4478-b51b-651d40bf091c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:48.754287 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1405/2773] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 09:07:48.755692 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b80ba-9915-48c9-ba2f-41324e2102f1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:48.768305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b80ba-9915-48c9-ba2f-41324e2102f1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:48.773923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9efb2-96ec-4d32-866f-ce5ba0e50040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:48.774735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9efb2-96ec-4d32-866f-ce5ba0e50040 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:48.775020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9efb2-96ec-4d32-866f-ce5ba0e50040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:48.775295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9efb2-96ec-4d32-866f-ce5ba0e50040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:48.775945 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9efb2-96ec-4d32-866f-ce5ba0e50040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:48.778128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9efb2-96ec-4d32-866f-ce5ba0e50040 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:48.867244 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1369/2774] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:07:48 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:48.871923 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcefa6d-e580-4478-b51b-651d40bf091c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:48.884283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcefa6d-e580-4478-b51b-651d40bf091c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:48.958398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ff1fe-b62d-4a67-9745-c20bb7184901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:48.959264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ff1fe-b62d-4a67-9745-c20bb7184901 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:48.959650 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ff1fe-b62d-4a67-9745-c20bb7184901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:48.960066 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ff1fe-b62d-4a67-9745-c20bb7184901 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:48.960755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ff1fe-b62d-4a67-9745-c20bb7184901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:48.967252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ff1fe-b62d-4a67-9745-c20bb7184901 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:49.087070 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1406/2775] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:07:48 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:49.091204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9efb2-96ec-4d32-866f-ce5ba0e50040 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:49.102473 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9efb2-96ec-4d32-866f-ce5ba0e50040 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:49.107146 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17bf78-0cec-4960-b663-f6ad961e82af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:49.107755 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17bf78-0cec-4960-b663-f6ad961e82af admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:49.108038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17bf78-0cec-4960-b663-f6ad961e82af admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:49.108310 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17bf78-0cec-4960-b663-f6ad961e82af admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:49.108967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17bf78-0cec-4960-b663-f6ad961e82af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:49.110645 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17bf78-0cec-4960-b663-f6ad961e82af admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:49.122264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1370/2776] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:49.126248 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ff1fe-b62d-4a67-9745-c20bb7184901 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:49.139628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ff1fe-b62d-4a67-9745-c20bb7184901 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:49.148440 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc669d18-57b7-411c-9362-313460dfa8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:49.149254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc669d18-57b7-411c-9362-313460dfa8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:49.149522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc669d18-57b7-411c-9362-313460dfa8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:49.149883 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc669d18-57b7-411c-9362-313460dfa8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:49.150658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc669d18-57b7-411c-9362-313460dfa8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:49.152781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc669d18-57b7-411c-9362-313460dfa8d2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:49.172508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1407/2777] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:49.176547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17bf78-0cec-4960-b663-f6ad961e82af admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:49.188056 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17bf78-0cec-4960-b663-f6ad961e82af admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:49.193768 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de6637-e6ea-4417-a02d-38b352a411be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:49.194469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de6637-e6ea-4417-a02d-38b352a411be admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:49.194751 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de6637-e6ea-4417-a02d-38b352a411be admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:49.195038 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de6637-e6ea-4417-a02d-38b352a411be admin admin] PATH_INFO: `/v3/projects/fc64ede5ae1d4562b7f49ffcb5c83718/users/4bbf5dec37f24defa1daf47f51d172b2/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:49.210936 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de6637-e6ea-4417-a02d-38b352a411be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc64ede5ae1d4562b7f49ffcb5c83718, user_id=4bbf5dec37f24defa1daf47f51d172b2, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:49.213821 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de6637-e6ea-4417-a02d-38b352a411be admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:49.293564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1371/2778] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:49 2022] PUT /identity/v3/projects/fc64ede5ae1d4562b7f49ffcb5c83718/users/4bbf5dec37f24defa1daf47f51d172b2/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:49.304689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795f29-a9b0-4fc9-ab8c-092eb09f0cb0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:49.306588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795f29-a9b0-4fc9-ab8c-092eb09f0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:49.306588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795f29-a9b0-4fc9-ab8c-092eb09f0cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:49.327610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:49.337208 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5d795f29-a9b0-4fc9-ab8c-092eb09f0cb0 None None] MFA Rules not processed for user `4bbf5dec37f24defa1daf47f51d172b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:49.338486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5d795f29-a9b0-4fc9-ab8c-092eb09f0cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:49.407722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1408/2779] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:49.412374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de6637-e6ea-4417-a02d-38b352a411be admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:49.418241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:49.480615 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de6637-e6ea-4417-a02d-38b352a411be admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:49.487030 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c0088-83b7-4ef8-851b-87f3c37b367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:49.487780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c0088-83b7-4ef8-851b-87f3c37b367e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:49.488588 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c0088-83b7-4ef8-851b-87f3c37b367e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:49.488861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c0088-83b7-4ef8-851b-87f3c37b367e admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:49.489554 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c0088-83b7-4ef8-851b-87f3c37b367e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:49.491511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c0088-83b7-4ef8-851b-87f3c37b367e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:49.576322 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1372/2780] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:07:49 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:07:49.580391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d795f29-a9b0-4fc9-ab8c-092eb09f0cb0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:49.595622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d795f29-a9b0-4fc9-ab8c-092eb09f0cb0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:49.668456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f1802-9802-4a14-8e6f-308d23f5fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:49.669330 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f1802-9802-4a14-8e6f-308d23f5fb52 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:49.669686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f1802-9802-4a14-8e6f-308d23f5fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:49.670161 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f1802-9802-4a14-8e6f-308d23f5fb52 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:49.671084 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f1802-9802-4a14-8e6f-308d23f5fb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:49.673802 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f1802-9802-4a14-8e6f-308d23f5fb52 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:49.815722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1409/2781] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:07:49 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:07:49.819851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c0088-83b7-4ef8-851b-87f3c37b367e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:49.831198 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c0088-83b7-4ef8-851b-87f3c37b367e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:49.836178 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627b257-233d-461e-816c-cac6d2d25e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:49.836880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627b257-233d-461e-816c-cac6d2d25e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:49.837237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627b257-233d-461e-816c-cac6d2d25e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:49.837609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627b257-233d-461e-816c-cac6d2d25e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:49.838377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627b257-233d-461e-816c-cac6d2d25e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:49.840166 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627b257-233d-461e-816c-cac6d2d25e73 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:49.857062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1373/2782] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:49.858327 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f1802-9802-4a14-8e6f-308d23f5fb52 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:49.880919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f1802-9802-4a14-8e6f-308d23f5fb52 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:49.886525 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7c37e-ce49-4293-a12a-55d7b6a37a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:49.887218 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7c37e-ce49-4293-a12a-55d7b6a37a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:49.887666 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7c37e-ce49-4293-a12a-55d7b6a37a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:49.887937 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7c37e-ce49-4293-a12a-55d7b6a37a77 admin admin] PATH_INFO: `/v3/projects/5ca29b283c4040b49ee791e86b4ffaa3/users/735f999bd2a5474183b96b2c9ad3f36d/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:49.904960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7c37e-ce49-4293-a12a-55d7b6a37a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca29b283c4040b49ee791e86b4ffaa3, user_id=735f999bd2a5474183b96b2c9ad3f36d, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:49.907817 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7c37e-ce49-4293-a12a-55d7b6a37a77 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:49.996744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1410/2783] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:49 2022] PUT /identity/v3/projects/5ca29b283c4040b49ee791e86b4ffaa3/users/735f999bd2a5474183b96b2c9ad3f36d/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:07:50.001083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627b257-233d-461e-816c-cac6d2d25e73 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:50.012117 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627b257-233d-461e-816c-cac6d2d25e73 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:50.078349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b651467-15c4-4275-89c5-0a4804d7f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:50.079252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651467-15c4-4275-89c5-0a4804d7f245 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:50.079604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651467-15c4-4275-89c5-0a4804d7f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:50.079950 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651467-15c4-4275-89c5-0a4804d7f245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:50.082359 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b651467-15c4-4275-89c5-0a4804d7f245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:50.084053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b651467-15c4-4275-89c5-0a4804d7f245 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:50.094943 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1374/2784] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:07:50.099800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7c37e-ce49-4293-a12a-55d7b6a37a77 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:50.115400 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7c37e-ce49-4293-a12a-55d7b6a37a77 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:50.120729 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871cf1c-939f-41da-9757-79a226318a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:50.121402 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871cf1c-939f-41da-9757-79a226318a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:50.121684 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871cf1c-939f-41da-9757-79a226318a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:50.121962 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871cf1c-939f-41da-9757-79a226318a24 admin admin] PATH_INFO: `/v3/projects/5ca29b283c4040b49ee791e86b4ffaa3/users/735f999bd2a5474183b96b2c9ad3f36d/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:50.137367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871cf1c-939f-41da-9757-79a226318a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca29b283c4040b49ee791e86b4ffaa3, user_id=735f999bd2a5474183b96b2c9ad3f36d, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:50.142942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871cf1c-939f-41da-9757-79a226318a24 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:50.158132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1411/2785] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:07:50 2022] PUT /identity/v3/projects/5ca29b283c4040b49ee791e86b4ffaa3/users/735f999bd2a5474183b96b2c9ad3f36d/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:07:50.166972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f997f-07ac-412d-ab66-6189c0743c90 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:50.167362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f997f-07ac-412d-ab66-6189c0743c90 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:50.167748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f997f-07ac-412d-ab66-6189c0743c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:50.201029 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b85f997f-07ac-412d-ab66-6189c0743c90 None None] MFA Rules not processed for user `735f999bd2a5474183b96b2c9ad3f36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:50.202248 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b85f997f-07ac-412d-ab66-6189c0743c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:50.288844 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:50.293470 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1375/2786] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:07:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:50.304524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871cf1c-939f-41da-9757-79a226318a24 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:50.306482 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5871cf1c-939f-41da-9757-79a226318a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:50.381612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871cf1c-939f-41da-9757-79a226318a24 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:50.385714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03a649-7153-41b9-a2e1-7cbc99a8a163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:50.386450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03a649-7153-41b9-a2e1-7cbc99a8a163 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:50.386782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03a649-7153-41b9-a2e1-7cbc99a8a163 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:50.387127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03a649-7153-41b9-a2e1-7cbc99a8a163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:50.391879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:07:50.460059 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03a649-7153-41b9-a2e1-7cbc99a8a163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:50.461677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03a649-7153-41b9-a2e1-7cbc99a8a163 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:50.471683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1412/2787] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:07:53.850977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda6c0-d6ff-4960-ae44-f31d0837c7d8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:53.851514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda6c0-d6ff-4960-ae44-f31d0837c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:53.851514 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda6c0-d6ff-4960-ae44-f31d0837c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:53.870619 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4acda6c0-d6ff-4960-ae44-f31d0837c7d8 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:07:53.871797 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4acda6c0-d6ff-4960-ae44-f31d0837c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:53.945726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1376/2788] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 09:07:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:07:53.959515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03a649-7153-41b9-a2e1-7cbc99a8a163 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:53.961086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4f03a649-7153-41b9-a2e1-7cbc99a8a163 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:54.043901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03a649-7153-41b9-a2e1-7cbc99a8a163 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:54.049235 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fe432-de8c-4298-990c-6f3e1b8ff7e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:54.049876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fe432-de8c-4298-990c-6f3e1b8ff7e4 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:54.050158 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fe432-de8c-4298-990c-6f3e1b8ff7e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:54.050567 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fe432-de8c-4298-990c-6f3e1b8ff7e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:54.080391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fe432-de8c-4298-990c-6f3e1b8ff7e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:54.082074 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fe432-de8c-4298-990c-6f3e1b8ff7e4 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:54.090809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1413/2789] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:07:55.635973 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acda6c0-d6ff-4960-ae44-f31d0837c7d8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:07:55.637395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4acda6c0-d6ff-4960-ae44-f31d0837c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:07:55.648724 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acda6c0-d6ff-4960-ae44-f31d0837c7d8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:07:55.652266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1d112-ea9a-40ef-8626-faedc12c4762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:07:55.652859 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1d112-ea9a-40ef-8626-faedc12c4762 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:07:55.653141 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1d112-ea9a-40ef-8626-faedc12c4762 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:07:55.653416 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1d112-ea9a-40ef-8626-faedc12c4762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:07:55.662273 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1d112-ea9a-40ef-8626-faedc12c4762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:07:55.663748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1d112-ea9a-40ef-8626-faedc12c4762 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:07:55.673372 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1377/2790] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:07:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:01.436656 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fe432-de8c-4298-990c-6f3e1b8ff7e4 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:01.501418 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fe432-de8c-4298-990c-6f3e1b8ff7e4 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:01.506032 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:01.506691 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:01.506991 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:01.507343 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] PATH_INFO: `/v3/users/4bbf5dec37f24defa1daf47f51d172b2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:01.508447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbf5dec37f24defa1daf47f51d172b2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:01.510508 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:01.696580 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:01.704768 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbf5dec37f24defa1daf47f51d172b2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:01.705479 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbf5dec37f24defa1daf47f51d172b2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:01.712857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbf5dec37f24defa1daf47f51d172b2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:01.799758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbf5dec37f24defa1daf47f51d172b2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:01.800522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbf5dec37f24defa1daf47f51d172b2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:01.818970 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1414/2791] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:08:01 2022] DELETE /identity/v3/users/4bbf5dec37f24defa1daf47f51d172b2 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:01.823886 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd8625-3ae9-419e-81e4-9075b75fa613 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:01.824374 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd8625-3ae9-419e-81e4-9075b75fa613 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:01.824482 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd8625-3ae9-419e-81e4-9075b75fa613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:01.843569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e2fd8625-3ae9-419e-81e4-9075b75fa613 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:01.844780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e2fd8625-3ae9-419e-81e4-9075b75fa613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:01.902316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1378/2792] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:01.912083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:01.913548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:01.971938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6c1d6-4af2-4078-9b3c-e33774b311a9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:01.975714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d20d1-245c-48e7-b42a-385de0124f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:01.976380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d20d1-245c-48e7-b42a-385de0124f45 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:01.976664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d20d1-245c-48e7-b42a-385de0124f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:01.976945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d20d1-245c-48e7-b42a-385de0124f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:01.986055 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d20d1-245c-48e7-b42a-385de0124f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:01.987610 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d20d1-245c-48e7-b42a-385de0124f45 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:01.997640 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1415/2793] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:02.404422 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd8625-3ae9-419e-81e4-9075b75fa613 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:02.408043 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e2fd8625-3ae9-419e-81e4-9075b75fa613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:02.418757 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd8625-3ae9-419e-81e4-9075b75fa613 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:02.423353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:02.423980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:02.424260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:02.424529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] PATH_INFO: `/v3/projects/fc64ede5ae1d4562b7f49ffcb5c83718` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:02.425652 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc64ede5ae1d4562b7f49ffcb5c83718)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:02.433190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:02.547806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc64ede5ae1d4562b7f49ffcb5c83718', 'request_id': 'req-e639a32c-c2ab-414e-b119-d7dc32960dd8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.554182 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc64ede5ae1d4562b7f49ffcb5c83718', 'request_id': 'req-e639a32c-c2ab-414e-b119-d7dc32960dd8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.560690 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc64ede5ae1d4562b7f49ffcb5c83718', 'request_id': 'req-e639a32c-c2ab-414e-b119-d7dc32960dd8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.627045 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] The token cache is being invalidate because project fc64ede5ae1d4562b7f49ffcb5c83718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:08:02.627467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.628096 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.629647 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1379/2794] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:08:02 2022] DELETE /identity/v3/projects/fc64ede5ae1d4562b7f49ffcb5c83718 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:02.633722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d20d1-245c-48e7-b42a-385de0124f45 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:02.643474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d20d1-245c-48e7-b42a-385de0124f45 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:02.700664 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:02.701288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:02.701569 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:02.701838 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] PATH_INFO: `/v3/users/735f999bd2a5474183b96b2c9ad3f36d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:02.703000 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735f999bd2a5474183b96b2c9ad3f36d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:02.704914 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:02.830265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735f999bd2a5474183b96b2c9ad3f36d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.830929 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735f999bd2a5474183b96b2c9ad3f36d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.838983 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735f999bd2a5474183b96b2c9ad3f36d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.842146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:02.896191 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735f999bd2a5474183b96b2c9ad3f36d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.896837 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-24a2433a-6fe7-4d37-a993-4798d5ddc985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735f999bd2a5474183b96b2c9ad3f36d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:02.917841 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1416/2795] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:08:02 2022] DELETE /identity/v3/users/735f999bd2a5474183b96b2c9ad3f36d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:08:03.331648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:03.333083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:03.346694 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639a32c-c2ab-414e-b119-d7dc32960dd8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:03.359544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:03.403519 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:03.404153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:03.404433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:03.404727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] PATH_INFO: `/v3/projects/5ca29b283c4040b49ee791e86b4ffaa3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:03.405847 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca29b283c4040b49ee791e86b4ffaa3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:03.407811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:03.554351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca29b283c4040b49ee791e86b4ffaa3', 'request_id': 'req-8ba50be5-77cd-4cdd-a10f-09e003e2002f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:03.560975 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca29b283c4040b49ee791e86b4ffaa3', 'request_id': 'req-8ba50be5-77cd-4cdd-a10f-09e003e2002f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:03.566428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca29b283c4040b49ee791e86b4ffaa3', 'request_id': 'req-8ba50be5-77cd-4cdd-a10f-09e003e2002f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:03.650962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] The token cache is being invalidate because project 5ca29b283c4040b49ee791e86b4ffaa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:08:03.651256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:03.651906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8ba50be5-77cd-4cdd-a10f-09e003e2002f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:03.653658 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1380/2796] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:08:03 2022] DELETE /identity/v3/projects/5ca29b283c4040b49ee791e86b4ffaa3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:03.659795 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7a44-e9ae-4f92-a8ec-25e2bfc32713 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:03.660374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7a44-e9ae-4f92-a8ec-25e2bfc32713 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:03.660547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7a44-e9ae-4f92-a8ec-25e2bfc32713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:03.681703 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-37af7a44-e9ae-4f92-a8ec-25e2bfc32713 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:03.683001 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-37af7a44-e9ae-4f92-a8ec-25e2bfc32713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:03.741157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1417/2797] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:08:03.749756 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b02fc-23aa-4c11-906c-778ad6f9804b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:03.750040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b02fc-23aa-4c11-906c-778ad6f9804b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:03.750344 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b02fc-23aa-4c11-906c-778ad6f9804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:03.770812 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f53b02fc-23aa-4c11-906c-778ad6f9804b None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:03.772004 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f53b02fc-23aa-4c11-906c-778ad6f9804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:03.780713 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1381/2798] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:03.789758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7a44-e9ae-4f92-a8ec-25e2bfc32713 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:03.799300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7a44-e9ae-4f92-a8ec-25e2bfc32713 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:03.804522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ddf92-aa34-4163-b694-2404b5a21226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:03.805073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ddf92-aa34-4163-b694-2404b5a21226 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:03.805895 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ddf92-aa34-4163-b694-2404b5a21226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:03.806176 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ddf92-aa34-4163-b694-2404b5a21226 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:03.806830 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ddf92-aa34-4163-b694-2404b5a21226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:08:03.807138 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ddf92-aa34-4163-b694-2404b5a21226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:03.808772 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ddf92-aa34-4163-b694-2404b5a21226 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:03.820456 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1418/2799] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:08:03.825436 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b02fc-23aa-4c11-906c-778ad6f9804b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:03.834871 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b02fc-23aa-4c11-906c-778ad6f9804b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:03.840864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1b930-d651-4baf-b7a7-3ea7d7cf8190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:03.841467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1b930-d651-4baf-b7a7-3ea7d7cf8190 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:03.841747 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1b930-d651-4baf-b7a7-3ea7d7cf8190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:03.842020 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1b930-d651-4baf-b7a7-3ea7d7cf8190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:03.842714 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1b930-d651-4baf-b7a7-3ea7d7cf8190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:03.844666 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1b930-d651-4baf-b7a7-3ea7d7cf8190 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:03.958367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1382/2800] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:08:03 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:08:03.963188 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ddf92-aa34-4163-b694-2404b5a21226 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:03.973156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ddf92-aa34-4163-b694-2404b5a21226 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:04.031455 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6d380-5843-40f0-84bc-70c06335cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:04.032061 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d380-5843-40f0-84bc-70c06335cf11 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:04.032401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d380-5843-40f0-84bc-70c06335cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:04.032682 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d380-5843-40f0-84bc-70c06335cf11 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:04.033323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6d380-5843-40f0-84bc-70c06335cf11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:04.035357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6d380-5843-40f0-84bc-70c06335cf11 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:04.111205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1419/2801] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:08:03 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:08:04.116486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1b930-d651-4baf-b7a7-3ea7d7cf8190 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:04.127150 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1b930-d651-4baf-b7a7-3ea7d7cf8190 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:04.131750 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58251-5298-4eed-8836-6b9a21ebe5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:04.132357 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58251-5298-4eed-8836-6b9a21ebe5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:04.132642 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58251-5298-4eed-8836-6b9a21ebe5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:04.132917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58251-5298-4eed-8836-6b9a21ebe5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:04.134126 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58251-5298-4eed-8836-6b9a21ebe5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:04.138531 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58251-5298-4eed-8836-6b9a21ebe5a8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:04.146241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1383/2802] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:08:04.150943 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6d380-5843-40f0-84bc-70c06335cf11 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:04.161090 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6d380-5843-40f0-84bc-70c06335cf11 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:04.166511 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1ef9c-a9a0-4724-96d2-37e4b6813fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:04.167104 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1ef9c-a9a0-4724-96d2-37e4b6813fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:04.167383 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1ef9c-a9a0-4724-96d2-37e4b6813fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:04.167654 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1ef9c-a9a0-4724-96d2-37e4b6813fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:04.168319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1ef9c-a9a0-4724-96d2-37e4b6813fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:04.169897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1ef9c-a9a0-4724-96d2-37e4b6813fc3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:04.179649 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1420/2803] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:08:04.184196 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58251-5298-4eed-8836-6b9a21ebe5a8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:04.194308 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58251-5298-4eed-8836-6b9a21ebe5a8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:04.199102 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c24d59-aaab-4a38-a64b-ae0298d77c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:04.199773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c24d59-aaab-4a38-a64b-ae0298d77c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:04.200050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c24d59-aaab-4a38-a64b-ae0298d77c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:04.200319 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c24d59-aaab-4a38-a64b-ae0298d77c87 admin admin] PATH_INFO: `/v3/projects/9e54f35dc70b4aa08fce979977b66fba/users/40f135b7a29745dca18069b651fe77ee/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:04.214923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c24d59-aaab-4a38-a64b-ae0298d77c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e54f35dc70b4aa08fce979977b66fba, user_id=40f135b7a29745dca18069b651fe77ee, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:04.217521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c24d59-aaab-4a38-a64b-ae0298d77c87 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:04.307306 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1384/2804] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:08:04 2022] PUT /identity/v3/projects/9e54f35dc70b4aa08fce979977b66fba/users/40f135b7a29745dca18069b651fe77ee/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:04.319506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6f618-5ba6-4724-bde9-24079dcefd6e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:04.319823 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6f618-5ba6-4724-bde9-24079dcefd6e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:04.320102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6f618-5ba6-4724-bde9-24079dcefd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:04.347571 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-14b6f618-5ba6-4724-bde9-24079dcefd6e None None] MFA Rules not processed for user `40f135b7a29745dca18069b651fe77ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:04.348761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14b6f618-5ba6-4724-bde9-24079dcefd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:04.378900 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:04.411665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1421/2805] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:04.449877 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c24d59-aaab-4a38-a64b-ae0298d77c87 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:04.451622 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-86c24d59-aaab-4a38-a64b-ae0298d77c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:04.498396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:04.511415 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c24d59-aaab-4a38-a64b-ae0298d77c87 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:04.515162 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d08d9-0a04-4f63-8855-5ab13ba7b796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:04.515780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d08d9-0a04-4f63-8855-5ab13ba7b796 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:04.516044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d08d9-0a04-4f63-8855-5ab13ba7b796 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:04.516312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d08d9-0a04-4f63-8855-5ab13ba7b796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:04.524565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d08d9-0a04-4f63-8855-5ab13ba7b796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:04.526569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d08d9-0a04-4f63-8855-5ab13ba7b796 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:04.535534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1385/2806] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:04.551727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6f618-5ba6-4724-bde9-24079dcefd6e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:04.614698 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6f618-5ba6-4724-bde9-24079dcefd6e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:04.619286 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:04.620002 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:04.620410 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:04.620577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] PATH_INFO: `/v3/users/40f135b7a29745dca18069b651fe77ee` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:04.621702 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f135b7a29745dca18069b651fe77ee)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:04.623658 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:04.801406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f135b7a29745dca18069b651fe77ee'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:04.802056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f135b7a29745dca18069b651fe77ee'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:04.809013 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f135b7a29745dca18069b651fe77ee'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:04.885003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f135b7a29745dca18069b651fe77ee'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:04.885613 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f135b7a29745dca18069b651fe77ee'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:04.904354 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1422/2807] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:08:04 2022] DELETE /identity/v3/users/40f135b7a29745dca18069b651fe77ee => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:04.908948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024d1d-a540-4661-9250-8b73ca3f498d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:04.909240 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024d1d-a540-4661-9250-8b73ca3f498d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:04.909515 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024d1d-a540-4661-9250-8b73ca3f498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:04.928421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-23024d1d-a540-4661-9250-8b73ca3f498d None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:04.929629 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-23024d1d-a540-4661-9250-8b73ca3f498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:04.988594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1386/2808] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:04.998809 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:05.000225 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:05.059110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34222944-6cc1-499a-b22a-9ec54f6a4e87 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:05.062821 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b98b-ef86-4005-bb21-bc3451b50369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:05.063434 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b98b-ef86-4005-bb21-bc3451b50369 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:05.063719 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b98b-ef86-4005-bb21-bc3451b50369 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:05.063995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b98b-ef86-4005-bb21-bc3451b50369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:05.070127 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:05.074616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4b98b-ef86-4005-bb21-bc3451b50369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:05.076912 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4b98b-ef86-4005-bb21-bc3451b50369 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:05.086205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1423/2809] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:05.549337 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024d1d-a540-4661-9250-8b73ca3f498d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:05.550989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-23024d1d-a540-4661-9250-8b73ca3f498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:05.564105 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024d1d-a540-4661-9250-8b73ca3f498d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:05.568729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:05.572592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:05.572592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:05.572592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] PATH_INFO: `/v3/projects/9e54f35dc70b4aa08fce979977b66fba` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:05.572592 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e54f35dc70b4aa08fce979977b66fba)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:05.573207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:05.661278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e54f35dc70b4aa08fce979977b66fba', 'request_id': 'req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:05.668375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e54f35dc70b4aa08fce979977b66fba', 'request_id': 'req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:05.674161 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e54f35dc70b4aa08fce979977b66fba', 'request_id': 'req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:05.752328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] The token cache is being invalidate because project 9e54f35dc70b4aa08fce979977b66fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:08:05.752497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:05.753108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8aa0b579-d2d5-4b51-acb7-83cb62deb59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:05.754628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1387/2810] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:08:05 2022] DELETE /identity/v3/projects/9e54f35dc70b4aa08fce979977b66fba => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:05.760031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a9197-19d9-4d12-94a9-348cc3a5fc16 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:05.760323 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a9197-19d9-4d12-94a9-348cc3a5fc16 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:05.760594 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a9197-19d9-4d12-94a9-348cc3a5fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:05.780535 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e46a9197-19d9-4d12-94a9-348cc3a5fc16 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:05.781718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e46a9197-19d9-4d12-94a9-348cc3a5fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:05.842616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1424/2811] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:08:05.850223 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c34c17-b4bf-47dc-8401-d0c36854a0ef None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:05.850516 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c34c17-b4bf-47dc-8401-d0c36854a0ef None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:05.850796 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c34c17-b4bf-47dc-8401-d0c36854a0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:05.870837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-20c34c17-b4bf-47dc-8401-d0c36854a0ef None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:05.872040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-20c34c17-b4bf-47dc-8401-d0c36854a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:05.879959 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1388/2812] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:08:05.884116 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a9197-19d9-4d12-94a9-348cc3a5fc16 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:05.893617 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a9197-19d9-4d12-94a9-348cc3a5fc16 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:05.898619 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fddb5-5f71-42b6-8d9c-c718118b66da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:05.899220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fddb5-5f71-42b6-8d9c-c718118b66da admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:05.899502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fddb5-5f71-42b6-8d9c-c718118b66da admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:05.899776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fddb5-5f71-42b6-8d9c-c718118b66da admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:05.900984 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fddb5-5f71-42b6-8d9c-c718118b66da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:08:05.901298 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fddb5-5f71-42b6-8d9c-c718118b66da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:05.902927 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fddb5-5f71-42b6-8d9c-c718118b66da admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:05.917460 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1425/2813] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:08:05.921811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c34c17-b4bf-47dc-8401-d0c36854a0ef None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:05.931490 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c34c17-b4bf-47dc-8401-d0c36854a0ef None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:05.937234 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e10be-01a9-4ad7-83c3-dd486aa90136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:05.937845 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e10be-01a9-4ad7-83c3-dd486aa90136 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:05.938200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e10be-01a9-4ad7-83c3-dd486aa90136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:05.938418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e10be-01a9-4ad7-83c3-dd486aa90136 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:05.939129 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e10be-01a9-4ad7-83c3-dd486aa90136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:05.940961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e10be-01a9-4ad7-83c3-dd486aa90136 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:06.023295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1389/2814] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:08:05 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:08:06.027997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fddb5-5f71-42b6-8d9c-c718118b66da admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:06.038797 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fddb5-5f71-42b6-8d9c-c718118b66da admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:06.098458 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ddeb-c397-41a4-b9bc-bf17755d857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:06.099076 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ddeb-c397-41a4-b9bc-bf17755d857b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:06.099357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ddeb-c397-41a4-b9bc-bf17755d857b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:06.099629 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ddeb-c397-41a4-b9bc-bf17755d857b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:06.100305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ddeb-c397-41a4-b9bc-bf17755d857b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:06.102299 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ddeb-c397-41a4-b9bc-bf17755d857b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:06.104754 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e10be-01a9-4ad7-83c3-dd486aa90136 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:06.106623 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-573e10be-01a9-4ad7-83c3-dd486aa90136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:06.150704 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:06.164628 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e10be-01a9-4ad7-83c3-dd486aa90136 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:06.168870 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5116ae-1a15-43fe-bb86-0054dab7f9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:06.169476 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5116ae-1a15-43fe-bb86-0054dab7f9fe service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:06.174115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5116ae-1a15-43fe-bb86-0054dab7f9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:06.174115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5116ae-1a15-43fe-bb86-0054dab7f9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:06.174115 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4f5116ae-1a15-43fe-bb86-0054dab7f9fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:06.199520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1426/2815] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:08:06 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:08:06.203548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ddeb-c397-41a4-b9bc-bf17755d857b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:06.213431 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ddeb-c397-41a4-b9bc-bf17755d857b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:06.218803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d324eb-a7ab-425b-921a-049f78fc4a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:06.219406 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d324eb-a7ab-425b-921a-049f78fc4a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:06.219717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d324eb-a7ab-425b-921a-049f78fc4a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:06.220040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d324eb-a7ab-425b-921a-049f78fc4a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:06.220686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d324eb-a7ab-425b-921a-049f78fc4a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:06.222488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d324eb-a7ab-425b-921a-049f78fc4a5d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:06.235381 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1427/2816] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:08:06.240675 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d324eb-a7ab-425b-921a-049f78fc4a5d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:06.243066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5116ae-1a15-43fe-bb86-0054dab7f9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:06.245237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5116ae-1a15-43fe-bb86-0054dab7f9fe service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:06.250958 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d324eb-a7ab-425b-921a-049f78fc4a5d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:06.255757 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a3743-0714-4c3f-81f1-0aff55fad2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:06.256358 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a3743-0714-4c3f-81f1-0aff55fad2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:06.256644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a3743-0714-4c3f-81f1-0aff55fad2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:06.256918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a3743-0714-4c3f-81f1-0aff55fad2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:06.257562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a3743-0714-4c3f-81f1-0aff55fad2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:06.259197 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a3743-0714-4c3f-81f1-0aff55fad2d5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:06.262293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1390/2817] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:08:06.270117 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1428/2818] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:08:06.274007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5116ae-1a15-43fe-bb86-0054dab7f9fe service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:06.285237 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5116ae-1a15-43fe-bb86-0054dab7f9fe service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:06.290267 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c4be7-93b1-4d0c-9b6c-0db9fb137876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:06.291433 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4be7-93b1-4d0c-9b6c-0db9fb137876 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:06.291722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4be7-93b1-4d0c-9b6c-0db9fb137876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:06.291992 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4be7-93b1-4d0c-9b6c-0db9fb137876 admin admin] PATH_INFO: `/v3/projects/c6a63a2aed9249c984c3751593918db6/users/5b7c0294c45445198d3656726b2928aa/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:06.307919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c4be7-93b1-4d0c-9b6c-0db9fb137876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a63a2aed9249c984c3751593918db6, user_id=5b7c0294c45445198d3656726b2928aa, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:06.310584 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c4be7-93b1-4d0c-9b6c-0db9fb137876 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:06.422361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1391/2819] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:08:06 2022] PUT /identity/v3/projects/c6a63a2aed9249c984c3751593918db6/users/5b7c0294c45445198d3656726b2928aa/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:06.433194 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159b69-1544-4d84-ab57-9ed4c2f35457 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:06.433487 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159b69-1544-4d84-ab57-9ed4c2f35457 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:06.433763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d159b69-1544-4d84-ab57-9ed4c2f35457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:06.460924 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2d159b69-1544-4d84-ab57-9ed4c2f35457 None None] MFA Rules not processed for user `5b7c0294c45445198d3656726b2928aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:06.462222 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2d159b69-1544-4d84-ab57-9ed4c2f35457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:06.502998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:06.529447 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1429/2820] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:06.541830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c4be7-93b1-4d0c-9b6c-0db9fb137876 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:06.543561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-941c4be7-93b1-4d0c-9b6c-0db9fb137876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:06.601854 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c4be7-93b1-4d0c-9b6c-0db9fb137876 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:06.606279 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5449f-18e5-4b08-a70e-b1f758db18e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:06.606891 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5449f-18e5-4b08-a70e-b1f758db18e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:06.607207 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5449f-18e5-4b08-a70e-b1f758db18e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:06.607480 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5449f-18e5-4b08-a70e-b1f758db18e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:06.615951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5449f-18e5-4b08-a70e-b1f758db18e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:06.617428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5449f-18e5-4b08-a70e-b1f758db18e4 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:06.627449 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1392/2821] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:16.623264 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:16.633053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:22.707565 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159b69-1544-4d84-ab57-9ed4c2f35457 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:22.773996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d159b69-1544-4d84-ab57-9ed4c2f35457 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:22.778457 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:22.779097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:22.779376 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:22.779647 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] PATH_INFO: `/v3/users/5b7c0294c45445198d3656726b2928aa` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:22.780787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7c0294c45445198d3656726b2928aa)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:22.782747 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:22.978478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7c0294c45445198d3656726b2928aa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:22.979146 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7c0294c45445198d3656726b2928aa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:22.986793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7c0294c45445198d3656726b2928aa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:23.049601 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7c0294c45445198d3656726b2928aa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:23.050187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7c0294c45445198d3656726b2928aa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:23.069014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1430/2822] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:08:22 2022] DELETE /identity/v3/users/5b7c0294c45445198d3656726b2928aa => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:23.073395 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f9990-b30b-4bac-8e63-6688af12efcc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:23.073893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f9990-b30b-4bac-8e63-6688af12efcc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:23.073994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f9990-b30b-4bac-8e63-6688af12efcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:23.093421 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ed3f9990-b30b-4bac-8e63-6688af12efcc None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:23.094676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ed3f9990-b30b-4bac-8e63-6688af12efcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:23.153293 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1393/2823] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:23.164102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:23.165560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:23.225538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325fcb3-97a2-405e-8a80-3379a8fbf737 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:23.229300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b53b91-c905-4827-824e-56e92f128cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:23.229900 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b53b91-c905-4827-824e-56e92f128cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:23.231149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b53b91-c905-4827-824e-56e92f128cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:23.231149 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b53b91-c905-4827-824e-56e92f128cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:23.240058 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b53b91-c905-4827-824e-56e92f128cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:23.241547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b53b91-c905-4827-824e-56e92f128cc7 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:23.251040 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1431/2824] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:23.649249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f9990-b30b-4bac-8e63-6688af12efcc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:23.650915 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ed3f9990-b30b-4bac-8e63-6688af12efcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:23.666542 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f9990-b30b-4bac-8e63-6688af12efcc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:23.671653 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:23.672467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:23.672816 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:23.673152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] PATH_INFO: `/v3/projects/c6a63a2aed9249c984c3751593918db6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:23.674485 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a63a2aed9249c984c3751593918db6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:23.676392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:23.792469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a63a2aed9249c984c3751593918db6', 'request_id': 'req-e96db328-a2e4-4784-a023-8b7cab224fae'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:23.798780 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a63a2aed9249c984c3751593918db6', 'request_id': 'req-e96db328-a2e4-4784-a023-8b7cab224fae'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:23.804324 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a63a2aed9249c984c3751593918db6', 'request_id': 'req-e96db328-a2e4-4784-a023-8b7cab224fae'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:23.866167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] The token cache is being invalidate because project c6a63a2aed9249c984c3751593918db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:08:23.867648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:23.867648 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:23.868624 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1394/2825] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:08:23 2022] DELETE /identity/v3/projects/c6a63a2aed9249c984c3751593918db6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:33.246876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:33.862671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:37.114677 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b53b91-c905-4827-824e-56e92f128cc7 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:37.123616 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b53b91-c905-4827-824e-56e92f128cc7 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:37.171163 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:37.171728 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:37.172006 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:37.172305 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:37.174676 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:37.237445 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:37.238904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:37.248428 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1432/2826] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:40.873771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:40.875271 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:40.950971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96db328-a2e4-4784-a023-8b7cab224fae admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:40.956651 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008e3d7-e489-4423-a68d-f7fde69c5484 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:40.957260 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008e3d7-e489-4423-a68d-f7fde69c5484 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:40.957539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008e3d7-e489-4423-a68d-f7fde69c5484 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:40.957839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008e3d7-e489-4423-a68d-f7fde69c5484 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:40.960209 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3008e3d7-e489-4423-a68d-f7fde69c5484 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:40.972763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008e3d7-e489-4423-a68d-f7fde69c5484 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:40.974575 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008e3d7-e489-4423-a68d-f7fde69c5484 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:40.988224 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1395/2827] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:40.996112 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:40.997807 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:41.015391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933dae4-88aa-4d34-a7b6-7b68022256c0 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:41.022642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:41.023481 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:41.023864 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:41.024240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] PATH_INFO: `/v3/users/a7120d37c24a48518e9b04c1c119eba5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:41.025534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7120d37c24a48518e9b04c1c119eba5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:41.027781 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:41.208292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7120d37c24a48518e9b04c1c119eba5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.208873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7120d37c24a48518e9b04c1c119eba5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.215779 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7120d37c24a48518e9b04c1c119eba5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.282740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7120d37c24a48518e9b04c1c119eba5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.283396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3d92ce1-baf4-49f9-aae1-204aa6a4dad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7120d37c24a48518e9b04c1c119eba5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.301598 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1433/2828] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:08:40 2022] DELETE /identity/v3/users/a7120d37c24a48518e9b04c1c119eba5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:08:41.565893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008e3d7-e489-4423-a68d-f7fde69c5484 service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:41.590601 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008e3d7-e489-4423-a68d-f7fde69c5484 service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:41.647717 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:41.648350 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:41.648630 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:41.648922 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] PATH_INFO: `/v3/projects/5e7e571271824d3db6930eb4158a5d88` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:41.650108 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7e571271824d3db6930eb4158a5d88)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:41.652109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:41.779919 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7e571271824d3db6930eb4158a5d88', 'request_id': 'req-0038a460-9894-4916-b931-4e7b49fbc97e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.786866 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7e571271824d3db6930eb4158a5d88', 'request_id': 'req-0038a460-9894-4916-b931-4e7b49fbc97e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.792668 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7e571271824d3db6930eb4158a5d88', 'request_id': 'req-0038a460-9894-4916-b931-4e7b49fbc97e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.841291 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] The token cache is being invalidate because project 5e7e571271824d3db6930eb4158a5d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:08:41.841520 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.842170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0038a460-9894-4916-b931-4e7b49fbc97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:08:41.843672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1396/2829] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:08:41 2022] DELETE /identity/v3/projects/5e7e571271824d3db6930eb4158a5d88 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:41.849231 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927bc6c-516f-4297-90cf-01e14f952453 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:41.853625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927bc6c-516f-4297-90cf-01e14f952453 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:41.853625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927bc6c-516f-4297-90cf-01e14f952453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:41.869085 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f927bc6c-516f-4297-90cf-01e14f952453 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:41.870526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f927bc6c-516f-4297-90cf-01e14f952453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:41.887089 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:41.928749 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1434/2830] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:41.936564 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b00195-315a-4611-ab45-a494a4971086 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:41.937040 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b00195-315a-4611-ab45-a494a4971086 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:41.937153 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b00195-315a-4611-ab45-a494a4971086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:41.956961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b0b00195-315a-4611-ab45-a494a4971086 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:41.958176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b0b00195-315a-4611-ab45-a494a4971086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:41.965933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1397/2831] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:41.970791 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927bc6c-516f-4297-90cf-01e14f952453 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:41.980557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927bc6c-516f-4297-90cf-01e14f952453 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:41.985071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bd5d7-63d6-4498-afe4-0c89f03e0f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:41.985689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bd5d7-63d6-4498-afe4-0c89f03e0f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:41.985969 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bd5d7-63d6-4498-afe4-0c89f03e0f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:41.986283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bd5d7-63d6-4498-afe4-0c89f03e0f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:41.986959 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bd5d7-63d6-4498-afe4-0c89f03e0f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:08:41.987265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bd5d7-63d6-4498-afe4-0c89f03e0f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:41.988869 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bd5d7-63d6-4498-afe4-0c89f03e0f23 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:42.000314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1435/2832] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 09:08:42.004221 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b00195-315a-4611-ab45-a494a4971086 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:42.013200 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b00195-315a-4611-ab45-a494a4971086 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:42.018249 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0fe9f-811c-49af-98b8-fc16bc327e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:42.018837 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0fe9f-811c-49af-98b8-fc16bc327e99 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:42.019114 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0fe9f-811c-49af-98b8-fc16bc327e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:42.019384 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0fe9f-811c-49af-98b8-fc16bc327e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:42.020002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0fe9f-811c-49af-98b8-fc16bc327e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:42.021872 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0fe9f-811c-49af-98b8-fc16bc327e99 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:42.033222 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:42.135807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1398/2833] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:08:42 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:08:42.140192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bd5d7-63d6-4498-afe4-0c89f03e0f23 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:42.150815 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bd5d7-63d6-4498-afe4-0c89f03e0f23 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:42.207132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82df83-d2d8-4f4f-be63-2ab2f9b9c94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:42.207725 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82df83-d2d8-4f4f-be63-2ab2f9b9c94e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:42.208008 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82df83-d2d8-4f4f-be63-2ab2f9b9c94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:42.208284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82df83-d2d8-4f4f-be63-2ab2f9b9c94e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:42.208913 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82df83-d2d8-4f4f-be63-2ab2f9b9c94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:42.210902 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82df83-d2d8-4f4f-be63-2ab2f9b9c94e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:42.288786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1436/2834] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:08:42 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:08:42.293079 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0fe9f-811c-49af-98b8-fc16bc327e99 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:42.303331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0fe9f-811c-49af-98b8-fc16bc327e99 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:42.308193 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e13aa-d72c-4829-8758-659a1d6eee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:42.308824 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e13aa-d72c-4829-8758-659a1d6eee65 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:42.309106 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e13aa-d72c-4829-8758-659a1d6eee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:42.309381 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e13aa-d72c-4829-8758-659a1d6eee65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:42.310026 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e13aa-d72c-4829-8758-659a1d6eee65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:42.311697 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e13aa-d72c-4829-8758-659a1d6eee65 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:42.322075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1399/2835] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:08:42.325949 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82df83-d2d8-4f4f-be63-2ab2f9b9c94e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:42.336573 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82df83-d2d8-4f4f-be63-2ab2f9b9c94e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:42.341195 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0cb9c3-2a76-4d94-b357-a6b0f3cd2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:42.341782 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cb9c3-2a76-4d94-b357-a6b0f3cd2bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:42.342063 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cb9c3-2a76-4d94-b357-a6b0f3cd2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:42.342366 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0cb9c3-2a76-4d94-b357-a6b0f3cd2bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:42.343006 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cb9c3-2a76-4d94-b357-a6b0f3cd2bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:42.344596 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0cb9c3-2a76-4d94-b357-a6b0f3cd2bbf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:42.355365 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1437/2836] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:08:42.359606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e13aa-d72c-4829-8758-659a1d6eee65 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:42.369841 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e13aa-d72c-4829-8758-659a1d6eee65 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:42.374763 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef47c2-3984-4900-ac93-cc8637edef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:42.375441 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef47c2-3984-4900-ac93-cc8637edef32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:42.375725 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef47c2-3984-4900-ac93-cc8637edef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:42.376513 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef47c2-3984-4900-ac93-cc8637edef32 admin admin] PATH_INFO: `/v3/projects/c3050455e1e04750bd3065bf206e86c1/users/45375507221545938929e8a5a9d3bdb9/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:42.392682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef47c2-3984-4900-ac93-cc8637edef32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3050455e1e04750bd3065bf206e86c1, user_id=45375507221545938929e8a5a9d3bdb9, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:42.395358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef47c2-3984-4900-ac93-cc8637edef32 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:42.460363 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1400/2837] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:08:42 2022] PUT /identity/v3/projects/c3050455e1e04750bd3065bf206e86c1/users/45375507221545938929e8a5a9d3bdb9/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:08:42.465462 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18c5d5-2c13-4ea2-b935-71bc2c2cddb9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:42.465755 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18c5d5-2c13-4ea2-b935-71bc2c2cddb9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:42.466056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18c5d5-2c13-4ea2-b935-71bc2c2cddb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:42.485054 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ba18c5d5-2c13-4ea2-b935-71bc2c2cddb9 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:42.486285 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ba18c5d5-2c13-4ea2-b935-71bc2c2cddb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:42.545419 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1438/2838] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:42.555465 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef47c2-3984-4900-ac93-cc8637edef32 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:42.557136 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7fef47c2-3984-4900-ac93-cc8637edef32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:42.613928 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef47c2-3984-4900-ac93-cc8637edef32 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:42.617603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f325c4d-e6a9-4375-9a82-868410d22430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:42.619305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f325c4d-e6a9-4375-9a82-868410d22430 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:42.619305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f325c4d-e6a9-4375-9a82-868410d22430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:42.619305 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f325c4d-e6a9-4375-9a82-868410d22430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:42.628340 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f325c4d-e6a9-4375-9a82-868410d22430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:42.629770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f325c4d-e6a9-4375-9a82-868410d22430 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:42.639235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1401/2839] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:47.895232 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fe63-1dd1-46e3-b57c-52b5b0f2f5a2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:47.895731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fe63-1dd1-46e3-b57c-52b5b0f2f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:47.895731 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fe63-1dd1-46e3-b57c-52b5b0f2f5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:47.928922 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1c71fe63-1dd1-46e3-b57c-52b5b0f2f5a2 None None] MFA Rules not processed for user `45375507221545938929e8a5a9d3bdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:47.930254 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1c71fe63-1dd1-46e3-b57c-52b5b0f2f5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:47.949778 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:08:48.022761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1439/2840] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:48.043659 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f325c4d-e6a9-4375-9a82-868410d22430 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:08:48.045142 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8f325c4d-e6a9-4375-9a82-868410d22430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:48.121537 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f325c4d-e6a9-4375-9a82-868410d22430 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:08:48.127275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78dd9-ae02-44c5-a94b-04cecadabfae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:08:48.127893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78dd9-ae02-44c5-a94b-04cecadabfae service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:48.128175 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78dd9-ae02-44c5-a94b-04cecadabfae service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:48.128447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78dd9-ae02-44c5-a94b-04cecadabfae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:48.136856 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b78dd9-ae02-44c5-a94b-04cecadabfae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:08:48.138505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b78dd9-ae02-44c5-a94b-04cecadabfae service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:08:48.148526 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1402/2841] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:08:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:08:50.386132 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c324a7-f140-4b30-a6c4-deea955b3a7e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:08:50.387053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c324a7-f140-4b30-a6c4-deea955b3a7e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:08:50.387338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c324a7-f140-4b30-a6c4-deea955b3a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:08:50.408681 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-95c324a7-f140-4b30-a6c4-deea955b3a7e None None] MFA Rules not processed for user `45375507221545938929e8a5a9d3bdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:08:50.409930 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-95c324a7-f140-4b30-a6c4-deea955b3a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:08:50.425160 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1440/2842] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:08:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:08:58.144033 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:00.403168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=22 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:22.729771 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78dd9-ae02-44c5-a94b-04cecadabfae service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:09:22.806352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78dd9-ae02-44c5-a94b-04cecadabfae service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:09:22.812689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe619fe-eb64-466f-bca8-8de1a6b0bedf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:09:22.813307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe619fe-eb64-466f-bca8-8de1a6b0bedf service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:09:22.813598 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe619fe-eb64-466f-bca8-8de1a6b0bedf service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:09:22.813864 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe619fe-eb64-466f-bca8-8de1a6b0bedf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:09:22.815726 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8fe619fe-eb64-466f-bca8-8de1a6b0bedf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:09:22.861834 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe619fe-eb64-466f-bca8-8de1a6b0bedf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:09:22.864185 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe619fe-eb64-466f-bca8-8de1a6b0bedf service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:09:22.886349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1403/2843] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:09:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:09:23.763053 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c324a7-f140-4b30-a6c4-deea955b3a7e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:09:23.764587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-95c324a7-f140-4b30-a6c4-deea955b3a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:09:23.885960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c324a7-f140-4b30-a6c4-deea955b3a7e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:09:23.891097 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:09:23.891918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:09:23.892185 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:09:23.892473 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:09:23.894233 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:09:23.907506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:09:23.909078 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:09:23.919404 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1441/2844] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:09:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:09:29.298477 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bc5fe-dd1d-48e6-beb4-37cb7f54fc39 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:09:29.303774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bc5fe-dd1d-48e6-beb4-37cb7f54fc39 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:09:29.303774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bc5fe-dd1d-48e6-beb4-37cb7f54fc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:09:29.329679 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-695bc5fe-dd1d-48e6-beb4-37cb7f54fc39 None None] MFA Rules not processed for user `afdc2662bd3148e3b120427adcc1a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:09:29.331023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-695bc5fe-dd1d-48e6-beb4-37cb7f54fc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:09:29.385354 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1404/2845] 10.222.0.33 () {58 vars in 967 bytes} [Tue Oct 4 09:09:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:09:29.547701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:09:29.549118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:09:29.616261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9485-7a35-4ad0-867c-953e911b5bfe service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:09:29.621210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320af90-a7c5-4d48-b7d0-58850accfe2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88353e858ec64a9cbdcfd16dbc00ebe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:09:29.621808 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320af90-a7c5-4d48-b7d0-58850accfe2f service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:09:29.622106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320af90-a7c5-4d48-b7d0-58850accfe2f service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:09:29.622416 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320af90-a7c5-4d48-b7d0-58850accfe2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:09:29.630391 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320af90-a7c5-4d48-b7d0-58850accfe2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:09:29.631971 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320af90-a7c5-4d48-b7d0-58850accfe2f service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:09:29.639917 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1442/2846] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Oct 4 09:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:09:33.994493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bc5fe-dd1d-48e6-beb4-37cb7f54fc39 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:09:34.014880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bc5fe-dd1d-48e6-beb4-37cb7f54fc39 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:09:34.025348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b77a-6c9b-41e7-a7c6-502929e2618a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:09:34.026775 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b77a-6c9b-41e7-a7c6-502929e2618a service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:09:34.027905 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b77a-6c9b-41e7-a7c6-502929e2618a service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:09:34.028706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07b77a-6c9b-41e7-a7c6-502929e2618a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:09:34.031977 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fa07b77a-6c9b-41e7-a7c6-502929e2618a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:09:34.047989 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07b77a-6c9b-41e7-a7c6-502929e2618a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:09:34.049677 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07b77a-6c9b-41e7-a7c6-502929e2618a service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:09:34.060486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1405/2847] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:09:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:09:37.644829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320af90-a7c5-4d48-b7d0-58850accfe2f service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:09:37.647091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1320af90-a7c5-4d48-b7d0-58850accfe2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:09:37.691524 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:37.694148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320af90-a7c5-4d48-b7d0-58850accfe2f service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:09:37.698648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:09:37.703576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:09:37.703576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:09:37.703576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] PATH_INFO: `/v3/users/8cdfe162e5c2471ba9fd239ab82789a9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:09:37.703576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cdfe162e5c2471ba9fd239ab82789a9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:09:37.703576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:09:37.868624 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cdfe162e5c2471ba9fd239ab82789a9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:37.869280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cdfe162e5c2471ba9fd239ab82789a9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:37.876265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cdfe162e5c2471ba9fd239ab82789a9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:37.935193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cdfe162e5c2471ba9fd239ab82789a9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:37.935827 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cdfe162e5c2471ba9fd239ab82789a9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:37.955396 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1443/2848] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:09:37 2022] DELETE /identity/v3/users/8cdfe162e5c2471ba9fd239ab82789a9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:09:38.199893 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b77a-6c9b-41e7-a7c6-502929e2618a service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:09:38.211242 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07b77a-6c9b-41e7-a7c6-502929e2618a service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:09:38.261243 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:38.267546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:09:38.271432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:09:38.271432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:09:38.271432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] PATH_INFO: `/v3/projects/f5afab629a1e4143a4d58209296fa908` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:09:38.271432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5afab629a1e4143a4d58209296fa908)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:09:38.272445 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:09:38.449670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5afab629a1e4143a4d58209296fa908', 'request_id': 'req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.455913 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5afab629a1e4143a4d58209296fa908', 'request_id': 'req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.461362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5afab629a1e4143a4d58209296fa908', 'request_id': 'req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.522765 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] The token cache is being invalidate because project f5afab629a1e4143a4d58209296fa908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:09:38.523055 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.523743 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.525292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1406/2849] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:09:38 2022] DELETE /identity/v3/projects/f5afab629a1e4143a4d58209296fa908 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:09:38.529448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:09:38.530918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:09:38.544612 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14897dc-da8f-489d-9e5b-7434fae69614 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:09:38.600110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:09:38.600740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:09:38.601016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:09:38.601292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] PATH_INFO: `/v3/users/1e4d4c52f73f46f489924537bf67835a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:09:38.602484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4d4c52f73f46f489924537bf67835a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:09:38.604392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:09:38.768141 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4d4c52f73f46f489924537bf67835a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.768777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4d4c52f73f46f489924537bf67835a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.776371 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4d4c52f73f46f489924537bf67835a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.831900 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4d4c52f73f46f489924537bf67835a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.833095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4d4c52f73f46f489924537bf67835a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:38.844174 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:38.850630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1444/2850] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:09:38 2022] DELETE /identity/v3/users/1e4d4c52f73f46f489924537bf67835a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:09:39.099634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:09:39.101067 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:09:39.113873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c742e1-a9de-4d84-9fd4-e81b1750cba3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:09:39.170716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:09:39.171397 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:09:39.171685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:09:39.171957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] PATH_INFO: `/v3/projects/e83fee72e94b446f8dc92b961f36fab7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:09:39.173085 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83fee72e94b446f8dc92b961f36fab7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:09:39.175032 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:09:39.268164 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83fee72e94b446f8dc92b961f36fab7', 'request_id': 'req-efe58283-21bf-40e2-a9c9-82b84980b2c3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:39.274826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83fee72e94b446f8dc92b961f36fab7', 'request_id': 'req-efe58283-21bf-40e2-a9c9-82b84980b2c3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:39.280368 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83fee72e94b446f8dc92b961f36fab7', 'request_id': 'req-efe58283-21bf-40e2-a9c9-82b84980b2c3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:39.374062 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] The token cache is being invalidate because project e83fee72e94b446f8dc92b961f36fab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:09:39.374382 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:39.375003 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-efe58283-21bf-40e2-a9c9-82b84980b2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:09:39.376487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1407/2851] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:09:39 2022] DELETE /identity/v3/projects/e83fee72e94b446f8dc92b961f36fab7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:09:48.931397 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:09:49.370933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=76,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:11:18.382938 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:11:18.384283 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:11:18.460413 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569744f8-b150-4fbd-b58c-bf6a47f94c2c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:11:18.506840 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:11:18.507438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:11:18.507715 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:11:18.507985 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:11:18.509705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:11:18.576964 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:11:18.578496 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:11:18.589377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1445/2852] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:11:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:11:26.148278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a413b39-f2ba-471f-a26b-a4c57775f8c5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:11:26.148833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a413b39-f2ba-471f-a26b-a4c57775f8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:11:26.148833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a413b39-f2ba-471f-a26b-a4c57775f8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:11:26.170703 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4a413b39-f2ba-471f-a26b-a4c57775f8c5 None None] MFA Rules not processed for user `45375507221545938929e8a5a9d3bdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:11:26.171981 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4a413b39-f2ba-471f-a26b-a4c57775f8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:11:26.225818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1408/2853] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:11:28.584449 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=83 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:11:36.218649 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=25 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:25.457003 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:25.458433 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:25.469600 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e16cd-f2eb-4cc0-8896-3ee2f2459f54 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:25.473226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:25.476279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:25.476279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:25.476279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:25.476279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:25.485904 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:25.487363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:25.495308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1446/2854] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:12:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:12:28.436471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a413b39-f2ba-471f-a26b-a4c57775f8c5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:28.437962 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4a413b39-f2ba-471f-a26b-a4c57775f8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:28.454025 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a413b39-f2ba-471f-a26b-a4c57775f8c5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:28.459729 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9be78b-4d7a-4ec2-aa18-b3cfdf6f2ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f31f738fe094e4ea7ed440e661e2111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:28.460527 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9be78b-4d7a-4ec2-aa18-b3cfdf6f2ba8 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:28.460811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9be78b-4d7a-4ec2-aa18-b3cfdf6f2ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:28.461088 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9be78b-4d7a-4ec2-aa18-b3cfdf6f2ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:28.462857 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6e9be78b-4d7a-4ec2-aa18-b3cfdf6f2ba8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:28.477968 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9be78b-4d7a-4ec2-aa18-b3cfdf6f2ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:28.480909 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9be78b-4d7a-4ec2-aa18-b3cfdf6f2ba8 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:28.493874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1409/2855] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:12:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:12:35.491847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:38.488465 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:38.789549 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:38.791020 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:38.856262 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad25615-8ac0-48c0-95a1-d89331b0ac21 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:38.860789 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:38.861409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:38.861688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:38.861961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] PATH_INFO: `/v3/users/45375507221545938929e8a5a9d3bdb9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:38.863118 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45375507221545938929e8a5a9d3bdb9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:38.865035 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:39.086792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45375507221545938929e8a5a9d3bdb9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.086792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45375507221545938929e8a5a9d3bdb9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.089910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45375507221545938929e8a5a9d3bdb9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.182371 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45375507221545938929e8a5a9d3bdb9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.182995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-811ca403-f989-4429-9362-e5ac4f77d093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45375507221545938929e8a5a9d3bdb9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.202106 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1447/2856] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:12:38 2022] DELETE /identity/v3/users/45375507221545938929e8a5a9d3bdb9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:39.453362 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9be78b-4d7a-4ec2-aa18-b3cfdf6f2ba8 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:39.464252 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9be78b-4d7a-4ec2-aa18-b3cfdf6f2ba8 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:39.520951 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:39.521644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:39.521840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:39.522130 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] PATH_INFO: `/v3/projects/c3050455e1e04750bd3065bf206e86c1` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:39.523245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3050455e1e04750bd3065bf206e86c1)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:39.532851 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:39.632571 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3050455e1e04750bd3065bf206e86c1', 'request_id': 'req-b63e19cd-f5b1-49e1-a977-8e8bd0503973'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.638731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3050455e1e04750bd3065bf206e86c1', 'request_id': 'req-b63e19cd-f5b1-49e1-a977-8e8bd0503973'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.644304 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3050455e1e04750bd3065bf206e86c1', 'request_id': 'req-b63e19cd-f5b1-49e1-a977-8e8bd0503973'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.727970 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] The token cache is being invalidate because project c3050455e1e04750bd3065bf206e86c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:12:39.728266 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.728948 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b63e19cd-f5b1-49e1-a977-8e8bd0503973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:39.730467 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1410/2857] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:12:39 2022] DELETE /identity/v3/projects/c3050455e1e04750bd3065bf206e86c1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:39.735976 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753733-947c-472d-9d2d-7f0d595fe73f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:39.736264 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753733-947c-472d-9d2d-7f0d595fe73f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:39.736538 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753733-947c-472d-9d2d-7f0d595fe73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:39.794572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a5753733-947c-472d-9d2d-7f0d595fe73f None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:39.795783 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a5753733-947c-472d-9d2d-7f0d595fe73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:39.837843 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:39.853062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1448/2858] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:39.861774 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48e21b-ee5c-40bd-82d0-eb633a391d96 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:39.862065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48e21b-ee5c-40bd-82d0-eb633a391d96 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:39.862375 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48e21b-ee5c-40bd-82d0-eb633a391d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:39.881829 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5b48e21b-ee5c-40bd-82d0-eb633a391d96 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:39.884276 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5b48e21b-ee5c-40bd-82d0-eb633a391d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:39.891216 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1411/2859] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:39.895392 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753733-947c-472d-9d2d-7f0d595fe73f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:39.906214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753733-947c-472d-9d2d-7f0d595fe73f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:39.911172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba5084-00bb-47eb-8528-85cb8bf0679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:39.911775 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba5084-00bb-47eb-8528-85cb8bf0679c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:39.912056 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba5084-00bb-47eb-8528-85cb8bf0679c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:39.912332 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba5084-00bb-47eb-8528-85cb8bf0679c admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:39.913050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba5084-00bb-47eb-8528-85cb8bf0679c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:12:39.913357 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba5084-00bb-47eb-8528-85cb8bf0679c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:39.915049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba5084-00bb-47eb-8528-85cb8bf0679c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:39.926982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1449/2860] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:12:39.931353 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48e21b-ee5c-40bd-82d0-eb633a391d96 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:39.940860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48e21b-ee5c-40bd-82d0-eb633a391d96 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:39.945565 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f562e5-cfd7-49b2-a367-d262ad36e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:39.946199 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f562e5-cfd7-49b2-a367-d262ad36e539 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:39.946487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f562e5-cfd7-49b2-a367-d262ad36e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:39.946762 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f562e5-cfd7-49b2-a367-d262ad36e539 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:39.947396 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f562e5-cfd7-49b2-a367-d262ad36e539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:39.949295 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f562e5-cfd7-49b2-a367-d262ad36e539 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:40.063410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1412/2861] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:12:39 2022] POST /identity/v3/projects => generated 405 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:12:40.067636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba5084-00bb-47eb-8528-85cb8bf0679c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:40.077856 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba5084-00bb-47eb-8528-85cb8bf0679c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:40.134109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a11a1f-9360-4c60-a368-9e6636084048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:40.134776 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a11a1f-9360-4c60-a368-9e6636084048 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:40.135005 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a11a1f-9360-4c60-a368-9e6636084048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:40.135279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a11a1f-9360-4c60-a368-9e6636084048 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:40.135942 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a11a1f-9360-4c60-a368-9e6636084048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:40.138563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a11a1f-9360-4c60-a368-9e6636084048 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:40.254745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1450/2862] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:12:40 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:12:40.258833 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f562e5-cfd7-49b2-a367-d262ad36e539 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:40.269885 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f562e5-cfd7-49b2-a367-d262ad36e539 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:40.274509 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6a51e-6a64-41bb-9276-88f218ce44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:40.275409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6a51e-6a64-41bb-9276-88f218ce44cf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:40.275708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6a51e-6a64-41bb-9276-88f218ce44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:40.276018 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6a51e-6a64-41bb-9276-88f218ce44cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:40.276667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6a51e-6a64-41bb-9276-88f218ce44cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:40.278897 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6a51e-6a64-41bb-9276-88f218ce44cf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:40.288961 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1413/2863] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:40.292955 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a11a1f-9360-4c60-a368-9e6636084048 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:40.303083 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a11a1f-9360-4c60-a368-9e6636084048 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:40.307717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e132f-ab03-417f-aadc-2554570fd5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:40.308306 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e132f-ab03-417f-aadc-2554570fd5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:40.308592 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e132f-ab03-417f-aadc-2554570fd5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:40.308862 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e132f-ab03-417f-aadc-2554570fd5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:40.309523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e132f-ab03-417f-aadc-2554570fd5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:40.311143 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e132f-ab03-417f-aadc-2554570fd5ee admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:40.321819 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1451/2864] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:40.326300 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6a51e-6a64-41bb-9276-88f218ce44cf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:40.336065 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6a51e-6a64-41bb-9276-88f218ce44cf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:40.340603 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881014e-c868-422b-97cd-6fe41f9cf6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:40.341753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881014e-c868-422b-97cd-6fe41f9cf6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:40.342037 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881014e-c868-422b-97cd-6fe41f9cf6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:40.342336 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881014e-c868-422b-97cd-6fe41f9cf6b6 admin admin] PATH_INFO: `/v3/projects/d821a08879884fbe8cd86dca305d5b93/users/2035a5dcd5f94533b976a28135ee5801/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:40.356487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881014e-c868-422b-97cd-6fe41f9cf6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d821a08879884fbe8cd86dca305d5b93, user_id=2035a5dcd5f94533b976a28135ee5801, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:40.359148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881014e-c868-422b-97cd-6fe41f9cf6b6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:40.431292 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1414/2865] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:12:40 2022] PUT /identity/v3/projects/d821a08879884fbe8cd86dca305d5b93/users/2035a5dcd5f94533b976a28135ee5801/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:40.436110 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6750-8932-4a72-b9c8-afa096a57d7c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:40.436401 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6750-8932-4a72-b9c8-afa096a57d7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:40.436695 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6750-8932-4a72-b9c8-afa096a57d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:40.455909 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fb4d6750-8932-4a72-b9c8-afa096a57d7c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:40.457117 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fb4d6750-8932-4a72-b9c8-afa096a57d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:40.515246 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1452/2866] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:40.524982 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881014e-c868-422b-97cd-6fe41f9cf6b6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:40.526734 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a881014e-c868-422b-97cd-6fe41f9cf6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:40.546609 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:40.583184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881014e-c868-422b-97cd-6fe41f9cf6b6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:40.586785 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe377ea-2b99-4877-9fb6-4bb48a5d3244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:40.587389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe377ea-2b99-4877-9fb6-4bb48a5d3244 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:40.587667 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe377ea-2b99-4877-9fb6-4bb48a5d3244 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:40.587939 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe377ea-2b99-4877-9fb6-4bb48a5d3244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:40.596880 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe377ea-2b99-4877-9fb6-4bb48a5d3244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:40.602039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe377ea-2b99-4877-9fb6-4bb48a5d3244 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:40.607792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1415/2867] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:12:41.779630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e454a-c858-428a-ae3e-0c0dbb77a51e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:41.780216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e454a-c858-428a-ae3e-0c0dbb77a51e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:41.780216 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e454a-c858-428a-ae3e-0c0dbb77a51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:41.811546 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c57e454a-c858-428a-ae3e-0c0dbb77a51e None None] MFA Rules not processed for user `2035a5dcd5f94533b976a28135ee5801`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:41.812765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c57e454a-c858-428a-ae3e-0c0dbb77a51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:41.859247 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:41.878997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1453/2868] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:41.883633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe377ea-2b99-4877-9fb6-4bb48a5d3244 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:41.893672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe377ea-2b99-4877-9fb6-4bb48a5d3244 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:41.898320 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c9aad-eadb-4e65-b218-4494d406f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:41.898912 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9aad-eadb-4e65-b218-4494d406f087 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:41.899190 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9aad-eadb-4e65-b218-4494d406f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:41.899464 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9aad-eadb-4e65-b218-4494d406f087 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:41.900339 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c9aad-eadb-4e65-b218-4494d406f087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:41.902259 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c9aad-eadb-4e65-b218-4494d406f087 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:42.015828 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1416/2869] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:12:41 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:12:42.017014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e454a-c858-428a-ae3e-0c0dbb77a51e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:42.028244 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e454a-c858-428a-ae3e-0c0dbb77a51e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:42.083839 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4c9a5-01ce-4cad-a67e-3eb3d6d68f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:42.084363 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4c9a5-01ce-4cad-a67e-3eb3d6d68f33 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:42.084642 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4c9a5-01ce-4cad-a67e-3eb3d6d68f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:42.084934 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4c9a5-01ce-4cad-a67e-3eb3d6d68f33 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:42.085560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4c9a5-01ce-4cad-a67e-3eb3d6d68f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:42.087502 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4c9a5-01ce-4cad-a67e-3eb3d6d68f33 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:42.194261 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1454/2870] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:12:42 2022] POST /identity/v3/users => generated 308 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:12:42.198404 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c9aad-eadb-4e65-b218-4494d406f087 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:42.209522 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c9aad-eadb-4e65-b218-4494d406f087 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:42.214226 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430cad1-49aa-4ca4-bb3f-6b5820d72f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:42.214830 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430cad1-49aa-4ca4-bb3f-6b5820d72f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:42.215109 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430cad1-49aa-4ca4-bb3f-6b5820d72f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:42.215387 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430cad1-49aa-4ca4-bb3f-6b5820d72f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:42.216051 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430cad1-49aa-4ca4-bb3f-6b5820d72f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:42.217650 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430cad1-49aa-4ca4-bb3f-6b5820d72f4f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:42.228177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1417/2871] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:42.232466 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4c9a5-01ce-4cad-a67e-3eb3d6d68f33 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:42.242509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4c9a5-01ce-4cad-a67e-3eb3d6d68f33 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:42.247648 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa70b24-3d9b-4f3d-9684-b9dfd8b0eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:42.248295 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa70b24-3d9b-4f3d-9684-b9dfd8b0eb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:42.248578 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa70b24-3d9b-4f3d-9684-b9dfd8b0eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:42.248857 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa70b24-3d9b-4f3d-9684-b9dfd8b0eb5d admin admin] PATH_INFO: `/v3/projects/17de56bf11af4a92856f4ad0ad6befbf/users/67f39732800148bd9968260d56800879/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:42.264342 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa70b24-3d9b-4f3d-9684-b9dfd8b0eb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=17de56bf11af4a92856f4ad0ad6befbf, user_id=67f39732800148bd9968260d56800879, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:42.267019 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa70b24-3d9b-4f3d-9684-b9dfd8b0eb5d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:42.347799 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1455/2872] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:12:42 2022] PUT /identity/v3/projects/17de56bf11af4a92856f4ad0ad6befbf/users/67f39732800148bd9968260d56800879/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:42.351875 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430cad1-49aa-4ca4-bb3f-6b5820d72f4f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:42.362578 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430cad1-49aa-4ca4-bb3f-6b5820d72f4f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:42.416656 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f3eb0-4f29-41af-b141-61d6274d2420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:42.417250 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f3eb0-4f29-41af-b141-61d6274d2420 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:42.417534 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f3eb0-4f29-41af-b141-61d6274d2420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:42.417807 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f3eb0-4f29-41af-b141-61d6274d2420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:42.418486 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f3eb0-4f29-41af-b141-61d6274d2420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:42.420543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f3eb0-4f29-41af-b141-61d6274d2420 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:42.429888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1418/2873] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:42.434156 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa70b24-3d9b-4f3d-9684-b9dfd8b0eb5d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:42.445168 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa70b24-3d9b-4f3d-9684-b9dfd8b0eb5d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:42.449803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48d34a-55f4-4efe-b245-722a6537e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:42.450509 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48d34a-55f4-4efe-b245-722a6537e20b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:42.450792 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48d34a-55f4-4efe-b245-722a6537e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:42.451069 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48d34a-55f4-4efe-b245-722a6537e20b admin admin] PATH_INFO: `/v3/projects/17de56bf11af4a92856f4ad0ad6befbf/users/67f39732800148bd9968260d56800879/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:42.452978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48d34a-55f4-4efe-b245-722a6537e20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17de56bf11af4a92856f4ad0ad6befbf, user_id=67f39732800148bd9968260d56800879, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:42.455644 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48d34a-55f4-4efe-b245-722a6537e20b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:42.465620 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1456/2874] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:12:42 2022] PUT /identity/v3/projects/17de56bf11af4a92856f4ad0ad6befbf/users/67f39732800148bd9968260d56800879/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:43.706942 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276edd3-fc72-4f4b-93bf-249ff22e80ef None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:43.707547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276edd3-fc72-4f4b-93bf-249ff22e80ef None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:43.707547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276edd3-fc72-4f4b-93bf-249ff22e80ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:43.735447 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c276edd3-fc72-4f4b-93bf-249ff22e80ef None None] MFA Rules not processed for user `67f39732800148bd9968260d56800879`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:43.736673 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c276edd3-fc72-4f4b-93bf-249ff22e80ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:43.810481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1419/2875] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:43 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:45.118842 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48d34a-55f4-4efe-b245-722a6537e20b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:45.181257 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48d34a-55f4-4efe-b245-722a6537e20b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:45.186421 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:45.188965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:45.188965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:45.188965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] PATH_INFO: `/v3/users/2035a5dcd5f94533b976a28135ee5801` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:45.188965 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2035a5dcd5f94533b976a28135ee5801)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:45.190582 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:45.376777 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:45.382520 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2035a5dcd5f94533b976a28135ee5801'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:45.383178 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2035a5dcd5f94533b976a28135ee5801'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:45.389928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2035a5dcd5f94533b976a28135ee5801'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:45.470898 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2035a5dcd5f94533b976a28135ee5801'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:45.471514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2035a5dcd5f94533b976a28135ee5801'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:45.490016 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1457/2876] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:12:45 2022] DELETE /identity/v3/users/2035a5dcd5f94533b976a28135ee5801 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:45.738403 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276edd3-fc72-4f4b-93bf-249ff22e80ef None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:45.748906 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276edd3-fc72-4f4b-93bf-249ff22e80ef None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:45.754204 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:45.807758 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:45.808391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:45.808678 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:45.808952 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] PATH_INFO: `/v3/projects/d821a08879884fbe8cd86dca305d5b93` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:45.810143 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d821a08879884fbe8cd86dca305d5b93)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:45.812081 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:45.945604 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd821a08879884fbe8cd86dca305d5b93', 'request_id': 'req-155968fa-3975-45b0-81b5-91715038cb5d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:45.951861 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd821a08879884fbe8cd86dca305d5b93', 'request_id': 'req-155968fa-3975-45b0-81b5-91715038cb5d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:45.957331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd821a08879884fbe8cd86dca305d5b93', 'request_id': 'req-155968fa-3975-45b0-81b5-91715038cb5d'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.050138 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] The token cache is being invalidate because project d821a08879884fbe8cd86dca305d5b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:12:46.050380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.051019 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.052511 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1420/2877] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:12:45 2022] DELETE /identity/v3/projects/d821a08879884fbe8cd86dca305d5b93 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:12:46.056588 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:46.057997 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:46.071206 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250f563-6555-44a3-9134-dad6613c1ba1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:46.125744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:46.126398 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:46.126657 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:46.126928 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] PATH_INFO: `/v3/users/67f39732800148bd9968260d56800879` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:46.128046 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f39732800148bd9968260d56800879)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:46.129961 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:46.282359 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f39732800148bd9968260d56800879'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.283025 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f39732800148bd9968260d56800879'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.290021 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f39732800148bd9968260d56800879'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.342157 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f39732800148bd9968260d56800879'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.342714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d503aed5-e189-4a6c-b5fb-bc7e9140e21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f39732800148bd9968260d56800879'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.360172 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1458/2878] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:12:46 2022] DELETE /identity/v3/users/67f39732800148bd9968260d56800879 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:46.586167 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:46.588307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:46.602236 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155968fa-3975-45b0-81b5-91715038cb5d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:46.658773 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:46.659393 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:46.659672 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:46.659944 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] PATH_INFO: `/v3/projects/17de56bf11af4a92856f4ad0ad6befbf` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:46.661039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17de56bf11af4a92856f4ad0ad6befbf)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:46.663119 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:46.785654 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:46.791613 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17de56bf11af4a92856f4ad0ad6befbf', 'request_id': 'req-5835519b-9c3c-4e5e-9362-ef214b2c49d8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.797791 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17de56bf11af4a92856f4ad0ad6befbf', 'request_id': 'req-5835519b-9c3c-4e5e-9362-ef214b2c49d8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.803452 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17de56bf11af4a92856f4ad0ad6befbf', 'request_id': 'req-5835519b-9c3c-4e5e-9362-ef214b2c49d8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.922054 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] The token cache is being invalidate because project 17de56bf11af4a92856f4ad0ad6befbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:12:46.922380 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.923007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5835519b-9c3c-4e5e-9362-ef214b2c49d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:46.924497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1421/2879] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:12:46 2022] DELETE /identity/v3/projects/17de56bf11af4a92856f4ad0ad6befbf => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:46.929494 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2355-b6df-4797-abaf-fe457bf7b315 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:46.929786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2355-b6df-4797-abaf-fe457bf7b315 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:46.930062 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2355-b6df-4797-abaf-fe457bf7b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:46.950816 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c29e2355-b6df-4797-abaf-fe457bf7b315 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:46.952015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c29e2355-b6df-4797-abaf-fe457bf7b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:46.982050 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:47.010279 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1459/2880] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:47.018066 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39026b00-3a3c-47a2-97b0-f72837921537 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.018405 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39026b00-3a3c-47a2-97b0-f72837921537 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.018685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39026b00-3a3c-47a2-97b0-f72837921537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.038352 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-39026b00-3a3c-47a2-97b0-f72837921537 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:47.039550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-39026b00-3a3c-47a2-97b0-f72837921537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:47.047985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1422/2881] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:47.052250 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e2355-b6df-4797-abaf-fe457bf7b315 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:47.063109 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e2355-b6df-4797-abaf-fe457bf7b315 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:47.067688 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3becb-c8ce-432e-8fe0-95b46386523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:47.068319 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3becb-c8ce-432e-8fe0-95b46386523a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.068625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3becb-c8ce-432e-8fe0-95b46386523a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.069353 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3becb-c8ce-432e-8fe0-95b46386523a admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.069576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3becb-c8ce-432e-8fe0-95b46386523a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:12:47.069880 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3becb-c8ce-432e-8fe0-95b46386523a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:47.071514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3becb-c8ce-432e-8fe0-95b46386523a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:47.083167 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1460/2882] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:12:47.087455 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39026b00-3a3c-47a2-97b0-f72837921537 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:47.096570 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39026b00-3a3c-47a2-97b0-f72837921537 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:47.101171 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a6c1-c6db-40e6-92d4-1242818f26ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:47.101759 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a6c1-c6db-40e6-92d4-1242818f26ec admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.102042 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a6c1-c6db-40e6-92d4-1242818f26ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.102343 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432a6c1-c6db-40e6-92d4-1242818f26ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.102973 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432a6c1-c6db-40e6-92d4-1242818f26ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:47.104855 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432a6c1-c6db-40e6-92d4-1242818f26ec admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:47.187018 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1423/2883] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:12:47 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:12:47.191077 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3becb-c8ce-432e-8fe0-95b46386523a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:47.201217 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3becb-c8ce-432e-8fe0-95b46386523a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:47.256284 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022ba15-975d-486e-95cd-36031540ea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:47.256882 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ba15-975d-486e-95cd-36031540ea61 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.257161 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ba15-975d-486e-95cd-36031540ea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.257432 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ba15-975d-486e-95cd-36031540ea61 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.258047 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022ba15-975d-486e-95cd-36031540ea61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:47.259982 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022ba15-975d-486e-95cd-36031540ea61 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:47.339627 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1461/2884] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:12:47 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:12:47.344235 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a6c1-c6db-40e6-92d4-1242818f26ec admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:47.354342 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432a6c1-c6db-40e6-92d4-1242818f26ec admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:47.359379 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb0d5-aa68-4335-a787-17e13e03c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:47.359972 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb0d5-aa68-4335-a787-17e13e03c222 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.360251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb0d5-aa68-4335-a787-17e13e03c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.360521 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb0d5-aa68-4335-a787-17e13e03c222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.361170 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb0d5-aa68-4335-a787-17e13e03c222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:47.362820 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb0d5-aa68-4335-a787-17e13e03c222 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:47.372793 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1424/2885] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:47.376584 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022ba15-975d-486e-95cd-36031540ea61 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:47.387175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022ba15-975d-486e-95cd-36031540ea61 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:47.392038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486636dd-c6f4-4857-9003-fd07c05877ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:47.392622 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486636dd-c6f4-4857-9003-fd07c05877ea admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.392903 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486636dd-c6f4-4857-9003-fd07c05877ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.393175 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486636dd-c6f4-4857-9003-fd07c05877ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.393814 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486636dd-c6f4-4857-9003-fd07c05877ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:47.395423 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486636dd-c6f4-4857-9003-fd07c05877ea admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:47.407547 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1462/2886] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:47.411557 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb0d5-aa68-4335-a787-17e13e03c222 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:47.422053 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb0d5-aa68-4335-a787-17e13e03c222 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:47.426716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975ee3-c1ca-4cb9-be2f-fc062637db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:47.427358 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975ee3-c1ca-4cb9-be2f-fc062637db19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.430687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975ee3-c1ca-4cb9-be2f-fc062637db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.430687 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21975ee3-c1ca-4cb9-be2f-fc062637db19 admin admin] PATH_INFO: `/v3/projects/20c36c7e52994406aa558964ac16368a/users/bb726f015dcb43d3a26e86e3b4d54636/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.442377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975ee3-c1ca-4cb9-be2f-fc062637db19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c36c7e52994406aa558964ac16368a, user_id=bb726f015dcb43d3a26e86e3b4d54636, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:47.445011 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21975ee3-c1ca-4cb9-be2f-fc062637db19 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:47.519145 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1425/2887] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:12:47 2022] PUT /identity/v3/projects/20c36c7e52994406aa558964ac16368a/users/bb726f015dcb43d3a26e86e3b4d54636/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:12:47.531099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788f1d5-6902-4f21-bd0c-9e79bbfce0dc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.531385 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788f1d5-6902-4f21-bd0c-9e79bbfce0dc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.531660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788f1d5-6902-4f21-bd0c-9e79bbfce0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.560215 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c788f1d5-6902-4f21-bd0c-9e79bbfce0dc None None] MFA Rules not processed for user `bb726f015dcb43d3a26e86e3b4d54636`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:47.561438 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c788f1d5-6902-4f21-bd0c-9e79bbfce0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:47.624344 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1463/2888] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:47.628776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975ee3-c1ca-4cb9-be2f-fc062637db19 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:47.689481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21975ee3-c1ca-4cb9-be2f-fc062637db19 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:47.694177 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04f388-15c8-4c38-ac7b-84061e9fcf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:47.694718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04f388-15c8-4c38-ac7b-84061e9fcf30 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.694999 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04f388-15c8-4c38-ac7b-84061e9fcf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.695274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04f388-15c8-4c38-ac7b-84061e9fcf30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.695901 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04f388-15c8-4c38-ac7b-84061e9fcf30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:47.697790 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04f388-15c8-4c38-ac7b-84061e9fcf30 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:47.788553 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1426/2889] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:12:47 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:12:47.792901 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788f1d5-6902-4f21-bd0c-9e79bbfce0dc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:47.803512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788f1d5-6902-4f21-bd0c-9e79bbfce0dc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:47.831908 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:47.858628 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224a27f-c358-408d-84f8-5264cde936a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:47.859220 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224a27f-c358-408d-84f8-5264cde936a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:47.859499 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224a27f-c358-408d-84f8-5264cde936a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:47.859774 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224a27f-c358-408d-84f8-5264cde936a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:47.860568 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224a27f-c358-408d-84f8-5264cde936a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:47.862458 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224a27f-c358-408d-84f8-5264cde936a6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:48.022553 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1464/2890] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:12:47 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:12:48.027152 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04f388-15c8-4c38-ac7b-84061e9fcf30 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:48.037546 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04f388-15c8-4c38-ac7b-84061e9fcf30 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:48.042311 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d158eda-114c-4ac4-9e9e-f5fa77658ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:48.042923 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158eda-114c-4ac4-9e9e-f5fa77658ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:48.047429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158eda-114c-4ac4-9e9e-f5fa77658ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:48.047429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158eda-114c-4ac4-9e9e-f5fa77658ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:48.047429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d158eda-114c-4ac4-9e9e-f5fa77658ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:48.047429 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d158eda-114c-4ac4-9e9e-f5fa77658ba3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:48.056392 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1427/2891] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:48.060879 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224a27f-c358-408d-84f8-5264cde936a6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:48.071102 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224a27f-c358-408d-84f8-5264cde936a6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:48.076394 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3596bf-fb69-4a62-85b0-96b13706fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:48.077042 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3596bf-fb69-4a62-85b0-96b13706fcac admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:48.077325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3596bf-fb69-4a62-85b0-96b13706fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:48.077597 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3596bf-fb69-4a62-85b0-96b13706fcac admin admin] PATH_INFO: `/v3/projects/f8b42414fab142b1b9abd4cede28586a/users/eb88cc0227b54ad9a40ecb8db9b4efc0/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:48.092353 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3596bf-fb69-4a62-85b0-96b13706fcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b42414fab142b1b9abd4cede28586a, user_id=eb88cc0227b54ad9a40ecb8db9b4efc0, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:48.095085 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3596bf-fb69-4a62-85b0-96b13706fcac admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:48.176045 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1465/2892] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:12:48 2022] PUT /identity/v3/projects/f8b42414fab142b1b9abd4cede28586a/users/eb88cc0227b54ad9a40ecb8db9b4efc0/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:48.180122 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d158eda-114c-4ac4-9e9e-f5fa77658ba3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:48.190493 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d158eda-114c-4ac4-9e9e-f5fa77658ba3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:48.227383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:48.244795 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9fad5-770e-454c-9f88-04a982f7bbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:48.245391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9fad5-770e-454c-9f88-04a982f7bbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:48.245670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9fad5-770e-454c-9f88-04a982f7bbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:48.245947 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9fad5-770e-454c-9f88-04a982f7bbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:48.246606 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9fad5-770e-454c-9f88-04a982f7bbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:48.248709 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9fad5-770e-454c-9f88-04a982f7bbc3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:48.258333 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1428/2893] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:48.262518 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3596bf-fb69-4a62-85b0-96b13706fcac admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:48.273556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3596bf-fb69-4a62-85b0-96b13706fcac admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:48.278374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fed849-08db-4b1c-95e5-3a4d271b7354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:48.279018 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fed849-08db-4b1c-95e5-3a4d271b7354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:48.279300 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fed849-08db-4b1c-95e5-3a4d271b7354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:48.279577 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fed849-08db-4b1c-95e5-3a4d271b7354 admin admin] PATH_INFO: `/v3/projects/f8b42414fab142b1b9abd4cede28586a/users/eb88cc0227b54ad9a40ecb8db9b4efc0/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:48.281484 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fed849-08db-4b1c-95e5-3a4d271b7354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b42414fab142b1b9abd4cede28586a, user_id=eb88cc0227b54ad9a40ecb8db9b4efc0, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:48.284187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fed849-08db-4b1c-95e5-3a4d271b7354 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:48.294184 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1466/2894] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:12:48 2022] PUT /identity/v3/projects/f8b42414fab142b1b9abd4cede28586a/users/eb88cc0227b54ad9a40ecb8db9b4efc0/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:48.304180 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ea249-8d39-4f7a-b6a2-340b86f2a401 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:48.304469 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ea249-8d39-4f7a-b6a2-340b86f2a401 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:48.304746 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ea249-8d39-4f7a-b6a2-340b86f2a401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:48.333633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cc5ea249-8d39-4f7a-b6a2-340b86f2a401 None None] MFA Rules not processed for user `eb88cc0227b54ad9a40ecb8db9b4efc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:48.334918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cc5ea249-8d39-4f7a-b6a2-340b86f2a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:48.401107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1429/2895] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:48.412718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fed849-08db-4b1c-95e5-3a4d271b7354 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:48.414514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47fed849-08db-4b1c-95e5-3a4d271b7354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:48.490832 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fed849-08db-4b1c-95e5-3a4d271b7354 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:48.494576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1ff87-983d-41e6-b9f0-94b773ede7f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:48.495169 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1ff87-983d-41e6-b9f0-94b773ede7f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:48.495450 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1ff87-983d-41e6-b9f0-94b773ede7f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:48.495723 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1ff87-983d-41e6-b9f0-94b773ede7f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:48.504540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1ff87-983d-41e6-b9f0-94b773ede7f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:48.505957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1ff87-983d-41e6-b9f0-94b773ede7f6 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:48.515718 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1467/2896] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:12:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:12:48.720213 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ea249-8d39-4f7a-b6a2-340b86f2a401 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:48.729840 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ea249-8d39-4f7a-b6a2-340b86f2a401 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:48.733487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10dcd0-4c03-4c3f-b191-ae4a75fe15aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:48.738960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10dcd0-4c03-4c3f-b191-ae4a75fe15aa service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:48.738960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10dcd0-4c03-4c3f-b191-ae4a75fe15aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:48.738960 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10dcd0-4c03-4c3f-b191-ae4a75fe15aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:48.790568 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10dcd0-4c03-4c3f-b191-ae4a75fe15aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:48.792001 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10dcd0-4c03-4c3f-b191-ae4a75fe15aa service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:48.800718 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1430/2897] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:12:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:12:57.222478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1ff87-983d-41e6-b9f0-94b773ede7f6 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:57.284144 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1ff87-983d-41e6-b9f0-94b773ede7f6 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:57.288576 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:57.289192 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:57.289468 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:57.289737 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] PATH_INFO: `/v3/users/bb726f015dcb43d3a26e86e3b4d54636` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:57.290867 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb726f015dcb43d3a26e86e3b4d54636)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:57.292767 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:57.297877 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:57.492041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb726f015dcb43d3a26e86e3b4d54636'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:57.492631 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb726f015dcb43d3a26e86e3b4d54636'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:57.499765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb726f015dcb43d3a26e86e3b4d54636'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:57.580919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb726f015dcb43d3a26e86e3b4d54636'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:57.581557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb726f015dcb43d3a26e86e3b4d54636'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:57.599714 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1468/2898] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:12:57 2022] DELETE /identity/v3/users/bb726f015dcb43d3a26e86e3b4d54636 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:57.604230 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8c3d5-8fcb-4c44-8f4b-e7ebbfe5f945 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:57.609225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8c3d5-8fcb-4c44-8f4b-e7ebbfe5f945 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:57.609225 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8c3d5-8fcb-4c44-8f4b-e7ebbfe5f945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:57.623699 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b2c8c3d5-8fcb-4c44-8f4b-e7ebbfe5f945 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:57.625048 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b2c8c3d5-8fcb-4c44-8f4b-e7ebbfe5f945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:57.674860 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:57.682986 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1431/2899] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:57.693240 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:57.694800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:57.750918 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20200ab3-c95b-4e83-9f24-fa9bcce369e7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:57.754560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba99354-7363-4806-86a6-4ce1d355eca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:57.755164 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba99354-7363-4806-86a6-4ce1d355eca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:57.755448 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba99354-7363-4806-86a6-4ce1d355eca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:57.755726 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba99354-7363-4806-86a6-4ce1d355eca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:57.764689 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba99354-7363-4806-86a6-4ce1d355eca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:57.766685 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba99354-7363-4806-86a6-4ce1d355eca2 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:57.776324 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1469/2900] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:12:58.192504 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8c3d5-8fcb-4c44-8f4b-e7ebbfe5f945 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:58.194044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b2c8c3d5-8fcb-4c44-8f4b-e7ebbfe5f945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:58.206361 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8c3d5-8fcb-4c44-8f4b-e7ebbfe5f945 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:58.210914 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:58.211552 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:58.211874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:58.212103 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] PATH_INFO: `/v3/projects/20c36c7e52994406aa558964ac16368a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:58.213278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c36c7e52994406aa558964ac16368a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:58.215219 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:58.321894 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c36c7e52994406aa558964ac16368a', 'request_id': 'req-78dc7ced-f2de-4a90-886c-e361b4781d39'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.327953 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c36c7e52994406aa558964ac16368a', 'request_id': 'req-78dc7ced-f2de-4a90-886c-e361b4781d39'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.333644 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c36c7e52994406aa558964ac16368a', 'request_id': 'req-78dc7ced-f2de-4a90-886c-e361b4781d39'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.409318 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] The token cache is being invalidate because project 20c36c7e52994406aa558964ac16368a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:12:58.409616 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.410280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.411770 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1432/2901] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:12:58 2022] DELETE /identity/v3/projects/20c36c7e52994406aa558964ac16368a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:58.415825 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba99354-7363-4806-86a6-4ce1d355eca2 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:58.426052 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba99354-7363-4806-86a6-4ce1d355eca2 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:58.481165 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:58.481787 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:58.482071 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:58.482377 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] PATH_INFO: `/v3/users/eb88cc0227b54ad9a40ecb8db9b4efc0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:58.483560 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb88cc0227b54ad9a40ecb8db9b4efc0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:58.485931 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:58.690727 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:58.703995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb88cc0227b54ad9a40ecb8db9b4efc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.704643 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb88cc0227b54ad9a40ecb8db9b4efc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.711409 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb88cc0227b54ad9a40ecb8db9b4efc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.775625 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb88cc0227b54ad9a40ecb8db9b4efc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.776241 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-781211fa-a4fa-49c3-977f-25a4565549e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb88cc0227b54ad9a40ecb8db9b4efc0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:58.793687 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1470/2902] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:12:58 2022] DELETE /identity/v3/users/eb88cc0227b54ad9a40ecb8db9b4efc0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:59.182316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:59.188738 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:59.199917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc7ced-f2de-4a90-886c-e361b4781d39 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:59.256497 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:59.257128 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:59.257411 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:59.257684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] PATH_INFO: `/v3/projects/f8b42414fab142b1b9abd4cede28586a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:59.258839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b42414fab142b1b9abd4cede28586a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:59.260735 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:59.356741 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b42414fab142b1b9abd4cede28586a', 'request_id': 'req-346b9844-a9f4-4707-b851-63c1ff2ef908'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:59.363547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b42414fab142b1b9abd4cede28586a', 'request_id': 'req-346b9844-a9f4-4707-b851-63c1ff2ef908'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:59.369058 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b42414fab142b1b9abd4cede28586a', 'request_id': 'req-346b9844-a9f4-4707-b851-63c1ff2ef908'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:59.460050 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] The token cache is being invalidate because project f8b42414fab142b1b9abd4cede28586a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:12:59.460274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:59.460902 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-346b9844-a9f4-4707-b851-63c1ff2ef908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:12:59.462409 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1433/2903] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:12:59 2022] DELETE /identity/v3/projects/f8b42414fab142b1b9abd4cede28586a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:12:59.467356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8ba8-5a7f-40fa-8828-4bb7db786245 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:59.471793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8ba8-5a7f-40fa-8828-4bb7db786245 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:59.471793 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b8ba8-5a7f-40fa-8828-4bb7db786245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:59.489563 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5e2b8ba8-5a7f-40fa-8828-4bb7db786245 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:59.490824 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5e2b8ba8-5a7f-40fa-8828-4bb7db786245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:59.548557 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1471/2904] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:59.611988 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a65e-36b3-4d38-a4d8-598c9148e55c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:59.612263 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a65e-36b3-4d38-a4d8-598c9148e55c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:59.612539 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84a65e-36b3-4d38-a4d8-598c9148e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:59.632075 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1d84a65e-36b3-4d38-a4d8-598c9148e55c None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:12:59.633278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1d84a65e-36b3-4d38-a4d8-598c9148e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:12:59.641543 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1434/2905] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:12:59.645705 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8ba8-5a7f-40fa-8828-4bb7db786245 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:59.656234 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b8ba8-5a7f-40fa-8828-4bb7db786245 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:59.660761 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b24f8f-87f2-40f8-b309-5d8d9bc5bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:59.661348 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b24f8f-87f2-40f8-b309-5d8d9bc5bed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:59.661626 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b24f8f-87f2-40f8-b309-5d8d9bc5bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:59.661897 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b24f8f-87f2-40f8-b309-5d8d9bc5bed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:59.662572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b24f8f-87f2-40f8-b309-5d8d9bc5bed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:12:59.662873 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b24f8f-87f2-40f8-b309-5d8d9bc5bed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:59.664459 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b24f8f-87f2-40f8-b309-5d8d9bc5bed5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:59.675665 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1472/2906] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:12:59.679792 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a65e-36b3-4d38-a4d8-598c9148e55c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:59.688682 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84a65e-36b3-4d38-a4d8-598c9148e55c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:59.693275 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddd3c9-6ee0-4543-97bd-cd3729625446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:59.693865 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddd3c9-6ee0-4543-97bd-cd3729625446 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:59.694184 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddd3c9-6ee0-4543-97bd-cd3729625446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:59.694462 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddd3c9-6ee0-4543-97bd-cd3729625446 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:59.695091 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddd3c9-6ee0-4543-97bd-cd3729625446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:59.696985 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddd3c9-6ee0-4543-97bd-cd3729625446 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:59.701383 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:12:59.776963 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1435/2907] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:12:59 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:12:59.781488 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b24f8f-87f2-40f8-b309-5d8d9bc5bed5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:59.791302 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b24f8f-87f2-40f8-b309-5d8d9bc5bed5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:59.845312 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893c522-1a9d-4fb2-a257-fb4670bd29d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:59.845896 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893c522-1a9d-4fb2-a257-fb4670bd29d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:59.846205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893c522-1a9d-4fb2-a257-fb4670bd29d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:59.846478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893c522-1a9d-4fb2-a257-fb4670bd29d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:59.847095 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893c522-1a9d-4fb2-a257-fb4670bd29d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:59.848998 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893c522-1a9d-4fb2-a257-fb4670bd29d7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:59.907408 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1473/2908] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:12:59 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:12:59.911487 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddd3c9-6ee0-4543-97bd-cd3729625446 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:59.921670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddd3c9-6ee0-4543-97bd-cd3729625446 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:59.926287 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd9408-8f5e-4e5d-a0fa-067282c593ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:59.926887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd9408-8f5e-4e5d-a0fa-067282c593ca admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:59.927163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd9408-8f5e-4e5d-a0fa-067282c593ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:59.927434 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd9408-8f5e-4e5d-a0fa-067282c593ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:59.928078 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd9408-8f5e-4e5d-a0fa-067282c593ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:59.929671 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd9408-8f5e-4e5d-a0fa-067282c593ca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:59.941151 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1436/2909] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:59.945236 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893c522-1a9d-4fb2-a257-fb4670bd29d7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:59.955947 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893c522-1a9d-4fb2-a257-fb4670bd29d7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:59.960740 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a51a7-bca4-41ef-b6bc-0ec87062acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:59.961367 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a51a7-bca4-41ef-b6bc-0ec87062acd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:59.961660 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a51a7-bca4-41ef-b6bc-0ec87062acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:59.961936 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a51a7-bca4-41ef-b6bc-0ec87062acd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:12:59.962876 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a51a7-bca4-41ef-b6bc-0ec87062acd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:12:59.964267 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a51a7-bca4-41ef-b6bc-0ec87062acd8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:12:59.975004 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1474/2910] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:12:59.979048 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd9408-8f5e-4e5d-a0fa-067282c593ca admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:12:59.988898 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd9408-8f5e-4e5d-a0fa-067282c593ca admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:12:59.993481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bafc9-10e2-43b3-bdbd-a8d02278bd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:12:59.994156 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bafc9-10e2-43b3-bdbd-a8d02278bd10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:12:59.994443 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bafc9-10e2-43b3-bdbd-a8d02278bd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:12:59.994722 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bafc9-10e2-43b3-bdbd-a8d02278bd10 admin admin] PATH_INFO: `/v3/projects/cf5a0b4284ea42af8724cc601c5519d6/users/a23987978ded41a099974c2400552649/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.009214 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bafc9-10e2-43b3-bdbd-a8d02278bd10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5a0b4284ea42af8724cc601c5519d6, user_id=a23987978ded41a099974c2400552649, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:00.011888 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bafc9-10e2-43b3-bdbd-a8d02278bd10 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:00.084425 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1437/2911] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:12:59 2022] PUT /identity/v3/projects/cf5a0b4284ea42af8724cc601c5519d6/users/a23987978ded41a099974c2400552649/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:13:00.094265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda03e34-c010-46d8-8192-cf9c07b3ddda None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:00.094556 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda03e34-c010-46d8-8192-cf9c07b3ddda None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:00.094860 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda03e34-c010-46d8-8192-cf9c07b3ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.119910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:13:00.122995 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eda03e34-c010-46d8-8192-cf9c07b3ddda None None] MFA Rules not processed for user `a23987978ded41a099974c2400552649`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:13:00.124852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eda03e34-c010-46d8-8192-cf9c07b3ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:00.187916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1475/2912] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:13:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:13:00.192408 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bafc9-10e2-43b3-bdbd-a8d02278bd10 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:00.252967 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bafc9-10e2-43b3-bdbd-a8d02278bd10 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:00.257684 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaacab-d48f-4a37-99ac-d3c12f29d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:00.258349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaacab-d48f-4a37-99ac-d3c12f29d120 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:00.258637 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaacab-d48f-4a37-99ac-d3c12f29d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:00.258918 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaacab-d48f-4a37-99ac-d3c12f29d120 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.259569 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaacab-d48f-4a37-99ac-d3c12f29d120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:00.261506 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaacab-d48f-4a37-99ac-d3c12f29d120 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:00.352083 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1438/2913] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:13:00 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:13:00.356193 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda03e34-c010-46d8-8192-cf9c07b3ddda None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:00.366847 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda03e34-c010-46d8-8192-cf9c07b3ddda None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:00.421945 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0195679-5e3b-4dcf-9bf5-d1ba6ed9d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:00.422574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195679-5e3b-4dcf-9bf5-d1ba6ed9d937 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:00.422852 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195679-5e3b-4dcf-9bf5-d1ba6ed9d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:00.423122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195679-5e3b-4dcf-9bf5-d1ba6ed9d937 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.423742 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0195679-5e3b-4dcf-9bf5-d1ba6ed9d937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:00.425636 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0195679-5e3b-4dcf-9bf5-d1ba6ed9d937 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:00.537204 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1476/2914] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:13:00 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:13:00.538438 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaacab-d48f-4a37-99ac-d3c12f29d120 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:00.548716 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaacab-d48f-4a37-99ac-d3c12f29d120 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:00.553351 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57666e1-07a9-4358-9903-bd7f3aca8075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:00.553957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57666e1-07a9-4358-9903-bd7f3aca8075 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:00.554280 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57666e1-07a9-4358-9903-bd7f3aca8075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:00.554544 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57666e1-07a9-4358-9903-bd7f3aca8075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.555189 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57666e1-07a9-4358-9903-bd7f3aca8075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:00.556779 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57666e1-07a9-4358-9903-bd7f3aca8075 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:00.567331 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1439/2915] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:13:00.575773 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0195679-5e3b-4dcf-9bf5-d1ba6ed9d937 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:00.586686 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0195679-5e3b-4dcf-9bf5-d1ba6ed9d937 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:00.591356 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7e0a0-5338-47bc-a129-31ed839605f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:00.592136 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7e0a0-5338-47bc-a129-31ed839605f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:00.592420 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7e0a0-5338-47bc-a129-31ed839605f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:00.593340 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7e0a0-5338-47bc-a129-31ed839605f8 admin admin] PATH_INFO: `/v3/projects/d018a4a9ad694891ad8e9b29f1eeb02e/users/30d2bce654464555a8ada462861a6ebe/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.608091 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7e0a0-5338-47bc-a129-31ed839605f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d018a4a9ad694891ad8e9b29f1eeb02e, user_id=30d2bce654464555a8ada462861a6ebe, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:00.611574 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7e0a0-5338-47bc-a129-31ed839605f8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:00.682049 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1477/2916] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:13:00 2022] PUT /identity/v3/projects/d018a4a9ad694891ad8e9b29f1eeb02e/users/30d2bce654464555a8ada462861a6ebe/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:13:00.685994 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57666e1-07a9-4358-9903-bd7f3aca8075 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:00.696593 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57666e1-07a9-4358-9903-bd7f3aca8075 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:00.751777 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c3ce6-bbfb-4f88-b5fd-6153f52167b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:00.752389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c3ce6-bbfb-4f88-b5fd-6153f52167b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:00.752670 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c3ce6-bbfb-4f88-b5fd-6153f52167b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:00.752941 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c3ce6-bbfb-4f88-b5fd-6153f52167b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.753577 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c3ce6-bbfb-4f88-b5fd-6153f52167b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:00.755206 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c3ce6-bbfb-4f88-b5fd-6153f52167b8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:00.764453 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1440/2917] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:13:00.769142 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7e0a0-5338-47bc-a129-31ed839605f8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:00.779540 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7e0a0-5338-47bc-a129-31ed839605f8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:00.784122 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc9b8c-1548-4fe9-b0c4-11180db37ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:00.784758 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc9b8c-1548-4fe9-b0c4-11180db37ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:00.785036 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc9b8c-1548-4fe9-b0c4-11180db37ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:00.785308 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc9b8c-1548-4fe9-b0c4-11180db37ca9 admin admin] PATH_INFO: `/v3/projects/d018a4a9ad694891ad8e9b29f1eeb02e/users/30d2bce654464555a8ada462861a6ebe/roles/935a135c8de34a7f9088b7a920d3caf2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.787255 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc9b8c-1548-4fe9-b0c4-11180db37ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d018a4a9ad694891ad8e9b29f1eeb02e, user_id=30d2bce654464555a8ada462861a6ebe, role_id=935a135c8de34a7f9088b7a920d3caf2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:00.789855 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc9b8c-1548-4fe9-b0c4-11180db37ca9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:00.799733 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1478/2918] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:13:00 2022] PUT /identity/v3/projects/d018a4a9ad694891ad8e9b29f1eeb02e/users/30d2bce654464555a8ada462861a6ebe/roles/935a135c8de34a7f9088b7a920d3caf2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:13:00.809748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bca432-0d7e-416a-97c5-668416756d08 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:00.810044 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bca432-0d7e-416a-97c5-668416756d08 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:00.810349 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bca432-0d7e-416a-97c5-668416756d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.839348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b4bca432-0d7e-416a-97c5-668416756d08 None None] MFA Rules not processed for user `30d2bce654464555a8ada462861a6ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:13:00.840550 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b4bca432-0d7e-416a-97c5-668416756d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:00.848461 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:13:00.908027 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1441/2919] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:13:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:13:00.919803 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc9b8c-1548-4fe9-b0c4-11180db37ca9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:00.921506 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-04bc9b8c-1548-4fe9-b0c4-11180db37ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:00.978683 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc9b8c-1548-4fe9-b0c4-11180db37ca9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:00.982322 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae581f-d507-44cf-908d-2d9fe0251edb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:00.982916 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae581f-d507-44cf-908d-2d9fe0251edb service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:00.983214 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae581f-d507-44cf-908d-2d9fe0251edb service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:00.983469 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae581f-d507-44cf-908d-2d9fe0251edb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:00.992098 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae581f-d507-44cf-908d-2d9fe0251edb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:00.993512 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae581f-d507-44cf-908d-2d9fe0251edb service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:00.997353 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:13:01.003756 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1479/2920] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:13:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:13:01.209887 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bca432-0d7e-416a-97c5-668416756d08 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:01.219594 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bca432-0d7e-416a-97c5-668416756d08 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:01.223124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f929077-a0e0-4c91-8d2c-b7ba55a25b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:01.223723 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f929077-a0e0-4c91-8d2c-b7ba55a25b36 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:01.224006 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f929077-a0e0-4c91-8d2c-b7ba55a25b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:01.224277 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f929077-a0e0-4c91-8d2c-b7ba55a25b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:01.280039 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f929077-a0e0-4c91-8d2c-b7ba55a25b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:01.281484 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f929077-a0e0-4c91-8d2c-b7ba55a25b36 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:01.290210 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1442/2921] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:13:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:13:04.737478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae581f-d507-44cf-908d-2d9fe0251edb service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:04.799526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae581f-d507-44cf-908d-2d9fe0251edb service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:04.803960 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:04.804572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:04.804854 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:04.805131 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] PATH_INFO: `/v3/users/a23987978ded41a099974c2400552649` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:04.806276 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23987978ded41a099974c2400552649)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:04.808187 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:05.018280 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23987978ded41a099974c2400552649'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.018910 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23987978ded41a099974c2400552649'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.026073 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23987978ded41a099974c2400552649'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.101031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23987978ded41a099974c2400552649'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.101615 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23987978ded41a099974c2400552649'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.118871 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1480/2922] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:13:04 2022] DELETE /identity/v3/users/a23987978ded41a099974c2400552649 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:13:05.123288 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce85bb-3c1e-47d4-8271-83d1ce82fd3e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:05.123776 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce85bb-3c1e-47d4-8271-83d1ce82fd3e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:05.123883 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce85bb-3c1e-47d4-8271-83d1ce82fd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:05.142980 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0bce85bb-3c1e-47d4-8271-83d1ce82fd3e None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:13:05.144179 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0bce85bb-3c1e-47d4-8271-83d1ce82fd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:05.201002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1443/2923] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:13:05.211270 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:05.212662 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:05.269701 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2478e7-deb2-4988-a73e-171991601e47 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:05.273562 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30766-211e-408e-b4d1-2517964a8762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:05.274189 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30766-211e-408e-b4d1-2517964a8762 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:05.274474 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30766-211e-408e-b4d1-2517964a8762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:05.274744 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30766-211e-408e-b4d1-2517964a8762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:05.283587 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a30766-211e-408e-b4d1-2517964a8762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:05.285038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a30766-211e-408e-b4d1-2517964a8762 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:05.294796 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1481/2924] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:13:05.708481 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce85bb-3c1e-47d4-8271-83d1ce82fd3e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:05.712316 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0bce85bb-3c1e-47d4-8271-83d1ce82fd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:05.722385 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce85bb-3c1e-47d4-8271-83d1ce82fd3e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:05.729424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:05.729424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:05.729424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:05.729424 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] PATH_INFO: `/v3/projects/cf5a0b4284ea42af8724cc601c5519d6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:05.736706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5a0b4284ea42af8724cc601c5519d6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:05.736706 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:05.815256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:13:05.822110 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5a0b4284ea42af8724cc601c5519d6', 'request_id': 'req-d613f192-5797-4b75-bf95-3e8b9a110bd8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.828418 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5a0b4284ea42af8724cc601c5519d6', 'request_id': 'req-d613f192-5797-4b75-bf95-3e8b9a110bd8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.833957 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5a0b4284ea42af8724cc601c5519d6', 'request_id': 'req-d613f192-5797-4b75-bf95-3e8b9a110bd8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.888440 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] The token cache is being invalidate because project cf5a0b4284ea42af8724cc601c5519d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:13:05.888731 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.889377 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:05.890917 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1444/2925] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:13:05 2022] DELETE /identity/v3/projects/cf5a0b4284ea42af8724cc601c5519d6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:13:05.894829 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30766-211e-408e-b4d1-2517964a8762 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:05.905522 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30766-211e-408e-b4d1-2517964a8762 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:05.922065 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:13:05.960651 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:05.961210 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:05.961486 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:05.961763 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] PATH_INFO: `/v3/users/30d2bce654464555a8ada462861a6ebe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:05.963031 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d2bce654464555a8ada462861a6ebe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:05.964996 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:06.097951 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d2bce654464555a8ada462861a6ebe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.098630 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d2bce654464555a8ada462861a6ebe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.105548 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d2bce654464555a8ada462861a6ebe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.175451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d2bce654464555a8ada462861a6ebe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.176082 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cee1d5f1-a3e2-4275-a3e3-4e2be1449a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d2bce654464555a8ada462861a6ebe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.193526 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1482/2926] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:13:05 2022] DELETE /identity/v3/users/30d2bce654464555a8ada462861a6ebe => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:13:06.569633 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:06.571176 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:06.584685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613f192-5797-4b75-bf95-3e8b9a110bd8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:06.640163 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:06.640806 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:06.641147 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:06.641428 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] PATH_INFO: `/v3/projects/d018a4a9ad694891ad8e9b29f1eeb02e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:06.642597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d018a4a9ad694891ad8e9b29f1eeb02e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:06.644595 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:06.741007 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd018a4a9ad694891ad8e9b29f1eeb02e', 'request_id': 'req-514814d5-6618-4660-8705-5704d1b502fd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.747432 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd018a4a9ad694891ad8e9b29f1eeb02e', 'request_id': 'req-514814d5-6618-4660-8705-5704d1b502fd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.753561 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd018a4a9ad694891ad8e9b29f1eeb02e', 'request_id': 'req-514814d5-6618-4660-8705-5704d1b502fd'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.814689 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] The token cache is being invalidate because project d018a4a9ad694891ad8e9b29f1eeb02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:13:06.814921 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.815547 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-514814d5-6618-4660-8705-5704d1b502fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:06.817107 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1445/2927] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:13:06 2022] DELETE /identity/v3/projects/d018a4a9ad694891ad8e9b29f1eeb02e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:13:06.822007 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3ff16-3a83-4339-815d-b726805f1d87 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:06.822478 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3ff16-3a83-4339-815d-b726805f1d87 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:06.822786 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3ff16-3a83-4339-815d-b726805f1d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:06.843075 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2de3ff16-3a83-4339-815d-b726805f1d87 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:13:06.844288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2de3ff16-3a83-4339-815d-b726805f1d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:06.902325 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1483/2928] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:13:06.910023 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e176c01-2032-491c-9d63-e1620c3a48d1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:06.910348 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e176c01-2032-491c-9d63-e1620c3a48d1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:06.910634 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e176c01-2032-491c-9d63-e1620c3a48d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:06.930307 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6e176c01-2032-491c-9d63-e1620c3a48d1 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:13:06.931620 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6e176c01-2032-491c-9d63-e1620c3a48d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:06.940328 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1446/2929] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:13:06.944523 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3ff16-3a83-4339-815d-b726805f1d87 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:06.954849 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3ff16-3a83-4339-815d-b726805f1d87 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:06.959346 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fd113-d1bb-4b8d-a7c7-24c7ae59d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:06.959948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fd113-d1bb-4b8d-a7c7-24c7ae59d12a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:06.960226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fd113-d1bb-4b8d-a7c7-24c7ae59d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:06.960503 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fd113-d1bb-4b8d-a7c7-24c7ae59d12a admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:06.961148 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fd113-d1bb-4b8d-a7c7-24c7ae59d12a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:13:06.961451 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fd113-d1bb-4b8d-a7c7-24c7ae59d12a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:06.963068 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fd113-d1bb-4b8d-a7c7-24c7ae59d12a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:06.974252 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1484/2930] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Oct 4 09:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:13:06.978285 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e176c01-2032-491c-9d63-e1620c3a48d1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:06.987471 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e176c01-2032-491c-9d63-e1620c3a48d1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:06.992100 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fec35-df67-4bdb-a79b-8381d6cf3dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:06.992685 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fec35-df67-4bdb-a79b-8381d6cf3dbc admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:06.992971 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fec35-df67-4bdb-a79b-8381d6cf3dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:06.993245 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fec35-df67-4bdb-a79b-8381d6cf3dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:06.993874 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fec35-df67-4bdb-a79b-8381d6cf3dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:06.995818 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fec35-df67-4bdb-a79b-8381d6cf3dbc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:07.112251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1447/2931] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Oct 4 09:13:06 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:13:07.116265 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fd113-d1bb-4b8d-a7c7-24c7ae59d12a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:07.127038 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fd113-d1bb-4b8d-a7c7-24c7ae59d12a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:07.150722 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:13:07.181743 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757b60f-6e77-47d5-819a-c594524ee4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:07.182369 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b60f-6e77-47d5-819a-c594524ee4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:07.182646 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b60f-6e77-47d5-819a-c594524ee4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:07.182915 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b60f-6e77-47d5-819a-c594524ee4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:07.183559 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757b60f-6e77-47d5-819a-c594524ee4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:07.185948 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757b60f-6e77-47d5-819a-c594524ee4f2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:07.260734 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1485/2932] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Oct 4 09:13:07 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:13:07.264753 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fec35-df67-4bdb-a79b-8381d6cf3dbc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:07.275298 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fec35-df67-4bdb-a79b-8381d6cf3dbc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:07.279933 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aae42-e8cf-4225-87c0-5a479ca2addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:07.280529 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aae42-e8cf-4225-87c0-5a479ca2addb admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:07.280811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aae42-e8cf-4225-87c0-5a479ca2addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:07.281087 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aae42-e8cf-4225-87c0-5a479ca2addb admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:07.281737 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aae42-e8cf-4225-87c0-5a479ca2addb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:07.283410 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aae42-e8cf-4225-87c0-5a479ca2addb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:07.292997 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1448/2933] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:13:07.297256 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757b60f-6e77-47d5-819a-c594524ee4f2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:07.306974 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757b60f-6e77-47d5-819a-c594524ee4f2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:07.312212 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24c4e4-6533-463d-bbe2-d8c35725e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:07.312800 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24c4e4-6533-463d-bbe2-d8c35725e756 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:07.313086 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24c4e4-6533-463d-bbe2-d8c35725e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:07.313362 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24c4e4-6533-463d-bbe2-d8c35725e756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:07.314009 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24c4e4-6533-463d-bbe2-d8c35725e756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:07.315638 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24c4e4-6533-463d-bbe2-d8c35725e756 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:07.325292 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1486/2934] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Oct 4 09:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:13:07.329183 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aae42-e8cf-4225-87c0-5a479ca2addb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:07.338839 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aae42-e8cf-4225-87c0-5a479ca2addb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:07.343601 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01456d4-70b2-4f97-8c2c-d3ee195e484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:07.344241 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01456d4-70b2-4f97-8c2c-d3ee195e484b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:07.344614 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01456d4-70b2-4f97-8c2c-d3ee195e484b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:07.344873 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01456d4-70b2-4f97-8c2c-d3ee195e484b admin admin] PATH_INFO: `/v3/projects/47fd921f3f604079ad3399ff76275e36/users/988c48b435944d8cb907aa8b0f8ed2d7/roles/522cad34ce354f77b50e5490fdb6174d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:07.359389 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01456d4-70b2-4f97-8c2c-d3ee195e484b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47fd921f3f604079ad3399ff76275e36, user_id=988c48b435944d8cb907aa8b0f8ed2d7, role_id=522cad34ce354f77b50e5490fdb6174d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:07.362002 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01456d4-70b2-4f97-8c2c-d3ee195e484b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:07.364212 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:13:07.449278 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1449/2935] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Oct 4 09:13:07 2022] PUT /identity/v3/projects/47fd921f3f604079ad3399ff76275e36/users/988c48b435944d8cb907aa8b0f8ed2d7/roles/522cad34ce354f77b50e5490fdb6174d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:13:07.459415 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa228a6c-4f9e-44c4-bf36-d18f3d910d70 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:07.459765 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa228a6c-4f9e-44c4-bf36-d18f3d910d70 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:07.460041 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa228a6c-4f9e-44c4-bf36-d18f3d910d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:07.488374 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fa228a6c-4f9e-44c4-bf36-d18f3d910d70 None None] MFA Rules not processed for user `988c48b435944d8cb907aa8b0f8ed2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:13:07.489572 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa228a6c-4f9e-44c4-bf36-d18f3d910d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:07.552678 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1487/2936] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:13:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:13:07.563448 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01456d4-70b2-4f97-8c2c-d3ee195e484b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:07.565172 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d01456d4-70b2-4f97-8c2c-d3ee195e484b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:07.621538 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01456d4-70b2-4f97-8c2c-d3ee195e484b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:07.625124 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a07ca-02c7-4250-8cca-fa862dd066ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4f8f6b881a9476bb0951bc68d17ca70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:07.625727 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a07ca-02c7-4250-8cca-fa862dd066ee service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:07.626009 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a07ca-02c7-4250-8cca-fa862dd066ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:07.626312 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a07ca-02c7-4250-8cca-fa862dd066ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:07.634505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a07ca-02c7-4250-8cca-fa862dd066ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:07.635938 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a07ca-02c7-4250-8cca-fa862dd066ee service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:07.644708 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1450/2937] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:13:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:13:14.335099 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa228a6c-4f9e-44c4-bf36-d18f3d910d70 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:14.395463 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa228a6c-4f9e-44c4-bf36-d18f3d910d70 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:14.400128 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:14.400745 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:14.401024 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:14.401301 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] PATH_INFO: `/v3/users/988c48b435944d8cb907aa8b0f8ed2d7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:14.402436 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988c48b435944d8cb907aa8b0f8ed2d7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:14.404338 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:14.539978 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:13:14.548659 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988c48b435944d8cb907aa8b0f8ed2d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:14.549314 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988c48b435944d8cb907aa8b0f8ed2d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:14.556303 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988c48b435944d8cb907aa8b0f8ed2d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:14.620207 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988c48b435944d8cb907aa8b0f8ed2d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:14.620855 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988c48b435944d8cb907aa8b0f8ed2d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:14.639251 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1488/2938] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Oct 4 09:13:14 2022] DELETE /identity/v3/users/988c48b435944d8cb907aa8b0f8ed2d7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:13:14.643748 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da1b53-4da6-4486-900e-d29c10e93314 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:14.644251 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da1b53-4da6-4486-900e-d29c10e93314 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:14.644391 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da1b53-4da6-4486-900e-d29c10e93314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:14.664505 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-06da1b53-4da6-4486-900e-d29c10e93314 None None] MFA Rules not processed for user `f4c8e66e98594150bb55f964ec327f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:13:14.665826 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-06da1b53-4da6-4486-900e-d29c10e93314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:14.722309 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1451/2939] 10.222.0.33 () {58 vars in 958 bytes} [Tue Oct 4 09:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:13:14.731878 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:14.733772 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:14.790515 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1d3be-3250-4a42-803e-a117fc977d31 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:14.794120 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3861-e9c1-4c49-9382-49e62660b559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b66989d4df4398ad723f587cbc24bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:14.794717 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3861-e9c1-4c49-9382-49e62660b559 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:14.794993 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3861-e9c1-4c49-9382-49e62660b559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:14.795288 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3861-e9c1-4c49-9382-49e62660b559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:14.804514 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3861-e9c1-4c49-9382-49e62660b559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:14.805956 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3861-e9c1-4c49-9382-49e62660b559 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:14.816015 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1489/2940] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:13:15.187811 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da1b53-4da6-4486-900e-d29c10e93314 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:13:15.189274 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-06da1b53-4da6-4486-900e-d29c10e93314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:13:15.201367 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da1b53-4da6-4486-900e-d29c10e93314 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:13:15.206332 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4c8e66e98594150bb55f964ec327f0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebfb49c53afc43dab99fad98da6b3e94', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:13:15.206974 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:13:15.207256 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:13:15.207597 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] PATH_INFO: `/v3/projects/47fd921f3f604079ad3399ff76275e36` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:13:15.208736 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47fd921f3f604079ad3399ff76275e36)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:13:15.210676 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:13:15.300501 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47fd921f3f604079ad3399ff76275e36', 'request_id': 'req-ca2090f4-0fca-44e3-b53c-977746b19cb6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:15.306740 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47fd921f3f604079ad3399ff76275e36', 'request_id': 'req-ca2090f4-0fca-44e3-b53c-977746b19cb6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:15.312148 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47fd921f3f604079ad3399ff76275e36', 'request_id': 'req-ca2090f4-0fca-44e3-b53c-977746b19cb6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:15.372463 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] The token cache is being invalidate because project 47fd921f3f604079ad3399ff76275e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:13:15.372852 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:15.373596 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ca2090f4-0fca-44e3-b53c-977746b19cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:13:15.375314 dv-cinder-844563-14-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1452/2941] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Oct 4 09:13:15 2022] DELETE /identity/v3/projects/47fd921f3f604079ad3399ff76275e36 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:13:24.811534 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=41,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:13:25.369074 dv-cinder-844563-14-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=2,keystone:SELECT=82,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:14:28.680762 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3861-e9c1-4c49-9382-49e62660b559 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:14:28.682226 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a77c3861-e9c1-4c49-9382-49e62660b559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:14:28.753380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3861-e9c1-4c49-9382-49e62660b559 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:14:28.818309 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ff1e-7e40-49c3-b3bb-22eb0162d1de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efba357340ac47dca0b1742d4e04fd7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a26eb92cd34484d85c22122d36b56c0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:14:28.818919 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ff1e-7e40-49c3-b3bb-22eb0162d1de service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:14:28.819230 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ff1e-7e40-49c3-b3bb-22eb0162d1de service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:14:28.819505 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ff1e-7e40-49c3-b3bb-22eb0162d1de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:14:28.821224 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bc62ff1e-7e40-49c3-b3bb-22eb0162d1de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:14:28.832380 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ff1e-7e40-49c3-b3bb-22eb0162d1de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:14:28.833957 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ff1e-7e40-49c3-b3bb-22eb0162d1de service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:14:28.844205 dv-cinder-844563-14-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1490/2942] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Oct 4 09:14:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:14:38.840014 dv-cinder-844563-14-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=58 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}